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ABSTRACT 

The Cooperative Institutional Research Program (CIRP) 
of the American Council on Education is an example of a systematic 
program of social and educational research in which survey methods 
using questionnaires constitute a major technique for collecting 
data. This longitudinal research program is dedicated to the study of 
higher education, particularly its impact on student development. In 
such a program, measurement error may affect data analysis and 
interpretation at each state of the research system through which 
data are transmitted and processed- That is, inaccuracy or 
imprecision in recorded response and in the statistics based on these 
data may occur not only during the solicitation of data but also 
during information transcription and file development. - The purpose of 
this report is to present empirical results about certain problems of 
measurement error in an educational survey system. These results are 
confined to measurements derived from items in the annual surveys of 
entering freshmen that are a basic part of the CIRP. After discussion 
the meaning and consequences of measurement error, the paper presents 
a review of the pertinent literature, and then presents the results 
of recent empirical investigations. (Author/HS) 
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Measurement Error in Social and Educational Survey Research 
Robert F. Boruch^ and John A. Creager 

With the development of large-scale longitudinal research programs in 
the behavioral sciences , the use of omnibus questionnaires to solicit data 
has greatly increased. Typically, such questionnaires reflect extensive 
and legitimate concerns about the impact of social, cultural, and education- 
al processes on the individual. - To determine causal and other functional 
relationships, data relevant to inputs, to treatments or environments, and 
to outcomes are collected and then subjected to analytical procedures, often 
of a multivariate, correlational nature, “in addition to their descriptive 
value, these data are being used more frequently as a basis for appraising 
policy and making management decisions. 

Data from survey questionnaires are, however, subject to measurement 
error, potentially a major source of inferential errors and, therefore, of 
erroneous recommendations based on the data. Although the nature and ef- 
fects of measurement error have been extensively treated in some areas of 
social and behavioral research, and empirical estimates of reliability of 
data are available for a variety of psychological measurements, there is 
little empirical information about measurement error in the data obtained 
by survey questionnaires which can be feasibly administered to a hetero- 
geneous sample of widely dispersed subjects. Even when available, such 
data are seldom explicitly related to the relevant theory of measurement 
error, its meaning and effect on analytical inference. This situation is 
hardly tolerable in view of the use made of such information in reaching 
important policy decisions. 

The Cooperative Institutional Research Program (CIRP) of the American 
Council on Education is an example of a systematic program of social and 
educational research in which survey methods using questionnaires consti- 
tute a major technique for collecting data. This longitudinal research 
program, described in greater detail elsewhere ( The ACE Office of Research : 
Its Purposes and Activities , 1972), is dedicated to the study of higher 
education, particularly its impact on student development. In such a pro- 
gram, measurement error may affect data analysis and interpretation at 
each stage of the research system through which data are transmitted and 

^uow with the Department of Psychology, Northwestern University. 
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processed. That is, inaccuracy or imprecision in recorded response, and in 
the statistics based on these data, may occur not only during the solici- 
tation of data, but also during information transcription, and file develop- 
ment. Moreover, many factors determine the nature and extent of errors: 
the substantive nature of the solicited information, the physical and ad- 
ministrative conditions under which the data are collected, and the charac- 
teristics of the relevant groups involved? e.g., the respondents, the re- 
searchers, and the users of the information. 

The purpose of this report is to present empirical results about cer- 
tain problems of measurement error in an educational survey system. These 
results are confined to measurements derived from items in the annual sur- 
veys of entering freshmen that are a basic part of the CIRP. The survey in- 
formation serves as input data for the longitudinal studies, and as the 
basis for published national norms on freshmen entering American institutions 
of higher education (Creager, Astin, Boruch, Bayer, and Drew, 1969). 

After discussing the meaning and consequences of measurement error, we 
present a review of the pertinent literature, and then give the results of 
recent empirical investigations which we have conducted. The discussion 
is restricted primarily to one method of measurement, the survey question- 
naire designed for efficient processing in large volume, and to one type 
of index of reliability, the temporal stability of item response. 

The Meaning of Measurement Error 

Measurement error is defined as the difference between a recorded re- 
sponse to an inquiry and a potentially measureable, true condition associ- 
ated with that inquiry. Some of the sources of measurement error in a sur- 
vey questionnaire item are the respondents faulty recall, his deliberate 
or accidental distortion of response, structural weakness or semantic am- 
biguity in the item, and lapses in the quality of data recording, trans- 
mission, and maintenance. Measurement error can be defined more precisely 
in terms of actual measurement operations. 

One starts with some conceptually definable attribute or condition of 
an observation unit (e.g., an individual subject) and some specified opera- 
tions purported to measure that attribute or condition. Empirical evidence 
shows that the resulting observed score is subject to variability when 
the operation is repeated. On the assumption (usually tacit) that the 
attribute or condition has not, in fact, changed, an observed score consists 
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of a variable error component in addition to the constant value or ’’true 
score" which an unchanged attribute should have yielded from the measure- 
ment operation. Unfortunately, no operation exists for partitioning a single 
observed score into independently determined values for the true score and 
the error components. In rare circumstances, the attribute or condition can 
I be determined independently, objectively, and accurately; the subject’s re- 

sponse may then be compared with the actual condition, in which case we can 
speak meaningfully of veracity of response. 

In the absence of operations for directly partitioning of a single ob- 
served score into true and error components, operations have been developed 
for partitioning the variances of these components, these variances being 
computed over defined groups of observation units. To accomplish this, we 
must introduce the assumption that, when averaged over a group of observa- 
tions, individual errors tend to cancel each other out yielding a zero mean, 
and that any statistical dependencies between errors and true scores also 
cancel out, yielding null covariances between the true score and error com- 
ponents. Because much of the methodology for data analysis involves vari- 
ances and covariances, this formulation has proved eminently practical for 
estimating measurement error and for studying its effects on other statis- 
tics , 

In this formulation of the problem, that an observed score consists of 
true score plus error, the assumptions discussed above permit the error term 
/ /to be regarded as a random variate, even though at the level of an individ- 

/ ual measurement, the sources of measurement error may be, and usually are, 

/ nonrandom in their occurrence and, therefore, in their effects on tue ob- 
/ / served score. Unlike the situation in the classical physical science where 

the chance speck of dust got into the control mechanism of a telescope, or 
into a crucible during chemical analysis — situations readily minimized by 
careful control of experimental conditions — some of the sources of measure- 
ment error in surveys, even where known, cannot readily be controlled by 
the investigator. To be sure, he can, and should, construct his instruments 
and use survey logistics which either reduce the likelihood of such errors 
or randomize the errors across observation units. Failing this, even the 
most elaborate theory and operations for coping with the effects of measure- 
ment error can only partially protect against inferential eri -'s. 

Given the basic formulation of measurement error as "va v on 
replication," a variety of experimental operations for further defining and 
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operatlonalizing concepts of measurement error can be derived. At issue is 
the nature of the replication. In classic psychometry, replication means 
subjecting the same observation units to a set of items presumed to measure 
the same attribute or condition; the interitem (or inter judge) agreement as 
measured by item covariances, is then used to assess the internal consistency 
of the item set. If a composite score is derived by summing responses to 
items in the set, and if the item-composite covariances are high, the set 
may be regarded as scalable . (Note that the pattern of item difficulties is 
also involved and affects the variance-covariance pattern in the set.) 

In many questionnaires, one is dealing not with a scalable set but with 
single items in a checklist or with specific questions (e.g., "What is your 
sex?"). In this situation, the internal consistency of an item set cannot 
be used to estimate measurement error. We need another kind of replication. 
When the same measurement operation is repeated at a later time, under con- 
ditions as similar to the first as possible, agreement on replication is 
called temporal stability . If observed change in a score overtime is to be 
regarded as measurement error, it is necessary to construct the operations 
such that the true attribute or condition has not in fact changed. The 
temporal stability concept applies both to responses to single items and to 
scores derived from scaled item sets. It can thus be applied to survey 
questionnaire data. Unfortunately, no operations exist for ascertaining 
that optimal retest time-lag which sharply separates changes in true score 
from measurement error. 

Finally, replication may consist of using two or more ostensibly differ- 
ent measurement operations, both of which purport to measure the same attri- 
bute or condition in question. The operations may differ either in the 
measuring instruments used (alternate forms) or in the experimental conditions 
of their administration. Because this third kind of replication, called 
equivalence , necessarily involves a time lapse, some confounding with tem- 
poral stability is inevitable. 

These various approaches to ascertaining measurement error based on 
replication of measurement of the same attribute or condition, are subsumed 
under the generic term reliability . When two measurements of presumably 
different attributes or conditions are compared, we normally speak of vali- 
dity. So-called face validity results from comparing a measurement opera- 
tion with an a priori concept of an attribute. With this exception, both 
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reliability and validity ate ascertained by correlations . If correlations 
are high) indicating measurement of the same attribute or condition, we 
usually think in reliability terms with lower, or moderate correlations being 
thought of as ’’validities." Any degree of uniqueness suggests that two 
measur em ent operations are not measuring the same thing, while any degree of 
communal ity less than unity suggests imperfect measurement of the same or 
similar functions. In practice coefficients may range from -1 to 1 so that 
a sharp empirical distinction between reliability and validity is not as 
convincing as the purposeful conceptions of scientists would lead us to ex- 
pect. Nevertheless, the classical distinction between reliability and vali- 
dity has proven to be a useful one. 

The Effects of Error on Analysis and Interpretation 

Whether one is estimating descriptive parameters or testing hypotheses 
about treatment effects, the major reason for concern about measurement 
errors is that they may affect any inferences drawn from the data. These in- 
ferences occur in analysis and interpretation and may ultimately damage the 
credibility and relevance of the reported results and recommendations to users 
of the information. The effects of measurement error ~ and, therefore, ap- 
propriate ways of coping with them — — differ somewhat according to whether one 
is dealing with continuous or multinomial data. We will first consider error 
in continuous data. 

A recent AERA Symposium (1.971) emphasized some of the risks in correla- 
tional analysis and dealt with ways of coping with these risks in the case of 
continuous variables (Finucci; Gleser; Stanley and Livingston; Edwards; 

Porter) . These papers review, criticize, and elaborate on classical attenua- 
tion theory, thus providing a useful approach to the problem. Astin (1970) 
makes explicit some effects of measurement error on substantive inferences 
drawn from analyses. Writing about the methodology of college impact research, 
he expresses special concern about the effects of measurement error in input 
variables on the input-output regression, pointing out that such errors may 
result in overestimating college impact when examining the output residualized 
on the input variables. 

Different patterns of measurement error across input (pretest) and treat- 
ment variables may result in an effect opposite to and confounded with the 

2 The symposium, "Some Attenuating Effects of Errors of Measurement," was 
organized by Julian C. Stanley and chaired by Gene V. Glass. 
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one discussed by As tin, in which case we may fail to detect controlled out- 
put differences and impacts when they actually occur. This point may be 
illustrated by the hypothetical case where a student input variable with re- 
liability of .95 based on mean observations within a college is correlated 
5 with a college characteristic variable with reliability of .60. If the 
true regression weights for predicting some outcome were both equal to 2.0, 
the regression weights estimated from the fallible data would be 1.47 and 
1.05, respectively. Not only is the importance of each variate underestimated, 
but also the student effect appears to be more important than the college 
effect. Moreover, the order of magnitude of the regression on weights may 
be completely reversed. Using formulas given by Cochran (1968), for example: 
if ’’true" regression coefficients were 2.0 for college effects and 1.0 for 
student effects, with reliabilities of .60 and 1.00, respectively, the esti- 
mated regression weights would be 1.15 and 1.25. This is not to say that 
previously reported results indicating student input to be more important 
than college effects are necessarily wrong, but rather that inferential errors 
may occur in either direction and that in a given analysis, measurement errors 
may have multiple effects which render the interpretation uncertain. 

Turning to misclassif ication error in multinomial data and contingency 
tables, Assakul and Proctor (1965) and Cochran (1968) provide scholarly 
treatment of this subject. With such data, the dependence of variances on 
means — and therefore of errors in estimating variances on errors in esti- 
mating means — makes the issue of how measurement error affects inference 
more complex than in the case of continuous variables, but we can say that, 
when data are fallible, true differences between groups or between the same 
group measured at different points in time will be more difficult to detect. 

One may appraise the credibility of an obtained percentage or Phi coefficient 
by estimating the misclassif ication rate and computing a statistic "corrected" 
for the error ; a computer program for obtaining tabulated values of maximum 
Phi for a variety of misclassif ication rates is given by Boruch (1972, in 
press) . 

These considerations emphasize the need for obtaining reliability esti- 
mates not only for student input variables but for environmental and outcome 
(dependent) variables as well. It is beyond the scope of the present study 
to provide such estimates, though a few comments are in order. The reliabili- 
ties of many college environmental variables have been reported by researchers, 
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like As tin, Holland, and Pace, who are concerned with assessing the college 
environment. Moreover, many of the outcome variables are retests of input 
variables, and therefore it is plausible to assume their reliabilities are 
similar to those on pretest. Nevertheless, data are needed to check this 
assumption and to provide estimates for those outcome variables which cannot 

be pretested. 

An Overview of Pertinent Research 

A number of writers in the scientific and educational research litera- 
ture have considered measurement error — e.g., Kish (1967), Cochran (1968), 

Parten (1950) , and Keating (1950) — but few have presented quantitative data 
on the topic. A recent exception is the presentation of data on self-reported 
high school grades and nor academic achievements (Maxey and Ormsby, 1971). 
Nevertheless, Bradburn (1969) and Siegel and Hodge (1968), among others, have 
outlined the weaknesses of current survey research, citing both the paucity 
of data and the inappropriateness of classical statistical models in dealing 

with fallible data. 

Although many journal articles report research based on fallible data, 
little or no attention is given to appraising empirically the extent of error 
or its impact on inferences. Menne, Klingensmith, and Nord (1969), after sys- 
tematically examining articles in all issues of six widely circulated educa- 
tional research journals published over a recent five-year period, concluded 
that, in at least half of the articles, insufficient attention was paid to 
the accuracy and precision of the cited measures. In only one journal did 
the number of articles that provided estimates of reliability of measurement 
exceed the number in which such estimates should have been made but were not. 

In the case of survey data the lack of reliability data is understandable 
even though undesirable. The logistic and cost constraints of obtaining em- 
pirical estimates of the reliability of survey data can be severe because suen 
estimates require replicated measurements under similar conditions with hetero- 
geneous and dispersed respondents. Nevertheless, existing data are helpful 
insofar as rough estimates of reliability for various survey item types can 
make analytical results more credible. 

Generation of Error as a Function of Item Type^ 

Astin (1965), Smith (1932), and Walsh (1967, 1968) have developed reliability 
estimates for a series of biographical items, including questions with factual 
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referents. Smith*s early Investigations of the stability of college students* 
responses to questionnaire surveys used a sample of only 50 students and a 
period of four months elapsed between the initial and second surveys. Ques- 
tions about the number of courses the student had failed resulted in the most 
stable responses (91-97 percent concordance) of all the questions pertaining 
to academic performance* whereas estimates of high school size and reports of 
high school extracurricular activities changes the most from test to retest 
(50-80 percent concordance) . 

Smith also reports interesting sex differences in the stability of reports 
of family attributes. Estimated parental income was changed on retest by 36 
percent of the women and by 46 percent of the men. Women were more variable 
in their answers about their fathers* occupations (11 percent change) than 
were men (5 percent change), but 13.6 percent of the men changed their response 
to a question about their mothers* occupations in contrast to only 4 percent 
of the women being inconsistent. 

Low stability was characteristic of responses to personal value items: 
least preferred extracurricular activities, favorite books, and favorite 
authors or historical figures. The highest stabilities were associated with 
queries about liking people, liking the opposite sex, and getting along with 
siblings; for all these items, the change in response was less than 20 per- 
cent. Although the small sample size makes these comparisons extremely tenu- 
ous, there is some confirmation of the results in other studies. 

As tin (1965) administered a questionnaire twice, with six weeks inter- 
vening, to a sample of 107 college students; questions on previous achieve- 
ments resulted in 90-100 percent agreement (binomial classes of response) be- 
tween survey and resurvey responses. Responses to items characterized by 
little ambiguity and by the "importance" of the accomplishment (e.g., "elected 
student president") had high rates of stability (95-100 percent). Achieve- 
ments of a more ambiguous sort (e.g., "received an award for leadership") re- 
sulted in slightly smaller rates of agreement (90-95 percent) . 

Responses to inquiries about other facts — e.g., father’s education and 
occupation, the student’s average high school grades, and certain nonacademic 
accomplishments — were subject to greater variability: The percentage agree- 

ment from survey to resurvey has a range of 74-92 percent. Attitudinal items 
and questions which solicited information on future plans (e.g., probable 
major field of study) typically involved concordances in the 60-70 percent 
range . 
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Walsh (1967, 1968) has investigated the relative accuracy of data from 
questionnaires, interviews, and biographical inventories in soliciting veri- 
fiable information from college students; he also provides a thorough review 
of pertinent research reported in the psychological literature. His inquiry 
was limited to questions pertaining to academic grades, major discipline, and 
number of semester hours completed. Forty-five students randomly selected 
from men’s residence halls in a large midwestern university were allocated to 
each of the three methods of data solicitation; their self-reports on grades, 
major fields, and semester hours completed were checked against administra- 
tive records. The results suggest that the method of soliciting information 
does not substantially affect the veracity of response to these limited types 
of questions. The self-reports about the number of courses dropped and the 
number of courses in which the student received a "D" or failing grade were 
most accurate (80-100 percent) . Least accurate were self-reports on cumula- 
tive or recent semester grade-point averages (50-80 percent) and retrospective 
reports of high school grades and rank in high school class (51-53 percent) . 
Again, because the sample size was small, these results are suggestive rather 

than definitive. 

Unfortunately, little is known about differential variability as a func- 
tion of sex, race, and other demographic characteristics of respondents, al- 
though some research (e.g., Bailar, 1968; Hansen, Hurwitz, and Pritzker, 

1964) suggests that such differences in response stability do exist. It is 
also plausible to expect that covariances in the response variations exist. 
Functional interdependence is certainly important insofar as many common 
techniques for accommodating measurement error assume that the variations are 
independent of one another and of the responses to questions about attributes 
under examination (Cochran, 1968). 

Further documentation of the statistics on measurement error is available 
insofar as many factual items in educational survey questionnaires overlap 
considerably with information solicited by the U.S. Census Bureau. These 
questions include age, sex, parental education and occupation, religious pre- 
ferences, and income levels. A prime basis for evaluating the survey-resurvey 
reliability of such items is furnished by Hansen, Hurwitz, and Pritzker (1964). 
The work of these researchers and of Bailar (1968) and Haber (1966) typify 
many of the investigations in this area, where simple variances of census 
interview-re inter view responses and other error parameters are estimated for 




16 



- 10 - 



subgroups of tills national population* Although only part of the Information 
from these studies is relevant to the college population, the statistics on 
variability reveal differential variability across subgroups for a specific 
attribute: Lower-income families are more likely to be inconsistent in their 

reports of income from one survey to the next than are upper-income families, 
even when the resurvey follows with a short time lag. 

Generation of Error in Data Processing 

The transcription of individual responses to a machine-readable mode 
(i.e., card or tape) is a second stage at which error may be introduced into 
the data system. Here, two broad areas are germane to large-scale surveys: 
the veracity of clerical transcription and the veracity of electromechanical 
transcription. 

Minton (1969) has perhaps done the most extensive work in the domain of 
processing. Although his research is based on the U.S. Census pro- 
cedures, the results are pertinent to other surveys. Minton discusses the 
detection and correction of defective data transcription from document to card 
mode, emphasizing quality control paradigms for classifying the nature, source, 
and extent of such error. He also discusses key-punching with dependent and 
independent verification, clerical coding, and proofreading of typed documents. 
Relying primarily on research conducted in 1950 and 1963 and involving small 
samples (1000-3500) of cards purposely inoculated with errors, Minton found 
that 3-4 percent of the defective items were undetected in 100 percent veri- 
fication of punched cards. Reverification of already verified cards yielded 
somewhat different error rates: 14 percent for a sample of 5,541 cards; 12 

percent for a sample of 3,314 cards. The discrepancy between the two sets of 
error rates is attributable, in part, to verifiers learning to recognize 
errors deliberately implanted in cards. Since the coding of responses to 
questionnaires is more influenced by interpretation and judgment, it can be 
expected to involve even higher rates of error and lower rates of error detec- 
tion. Minton found that, with this type of operation, 30-70 percent of de- 
fectives were corrected in sample verification. 

The accuracy of commercial mark sensing devices (mechanical, electrical, 
or optical) when used in survey questionnaire processing has not been treated 
extensively in published research, although occasional technical memoranda 
and anecdotal evidence are available. Such reports are generally characterized 
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by interest in the number of machine readable marks made on a document, as 
compared with the total number of marks on a document. Studies by Valentine 
(1959, 1960) concern the effect of light, medium, and heavy pressure on the 
sensing capability of a mark sensing device (a machine currently used in com- 
mercial and educational operations). A single mark in response to a query is 
made by the respondent on each sector of a mark sense card. A defective card 
was defined as one where the marks were too light for sensing in some sectors 
or where a single sector contained multiple marks. The rejection of defec- 
tive cards was approximately 33 percent for light marking, 11 percent for 
normal pressure, and 3 percent for heavy pressure (sample size of 428 with 
five sectors per card) . The use of mechanical rather than wooden pencils re- 
sulted in near-zero rejection rates. 

Frequently, commercial and research organizations that require large- 
scale data processing conduct accuracy tests on mark sensing devices prior to 
purchasing such equipment. The results of such tests are rarely published, 
however, so relevant data are sparse. One exception is a study by Spencer 
(1966) of the reliability of a highly standardized DIGITEK test-scoring de- 
vice. The results provided by the machine agreed highly with error-free re- 
sults derived by hand-scoring with verification: Reliability in scoring was 

99 percent with 99.4 percent stability (i.e., overlap in results of repeated 

scoring of the same protocols by machine) . 

Personal communications between clients and vendors of different equip- 
ment are more typically the mode of information exchange. For the survey ques- 
tionnaire considered in this report, the reliability of scoring by optical 
scanning is said to be in the range 92-99.5 percent. The most recent data on 
the optical scanning equipment used suggests that reliability is near 100 
percent when the ratio of dark or heavy pressure marks to light marks and 
omissions is high. As the proportions of light marks on an answer form in- 
creases, the sensing capability becomes less accurate (Dillon, 1970). 

Computerized editing can be used to detect and correct defective data 
generated at earlier levels of the research system. This procedure is typi- 
cally used to discover errors and to correct the data for further analysis. 
Processing is directed toward detecting inconsistencies and contradictions in 
the data in cases where external and internal criteria can be employed to 
define consistency. If one knows the total frequencies and percentages, the 
output from data processing can be monitored; the range of allowable responses 
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can be checked to insure that no gross errors are committed; the extent of 
missing data may also be examined* Internal consistency is typically deter- 
mined by checking certain internal counts against alternative criteria. More- 
over, sample data with known errors (i.e., a ’’hot deck”) may be used to iden- 
tify and correct internal operations which function as devices for quality 
control, Freund and Hartley (1967) present examples of such procedures and 
describe flow charts for computer programs that may be helpful in editing the 
data. Their methods of inferring erroneous data depend on the logical consis- 
tency of the relations among data, and on the empirical reliability and vari- 
ability of the defect-free information in the data file. Examples of similar 
algorithms and programs for computer editing are furnished occasionally in 
Datamation , Educational and Psychological Measurement , and other technical 
journals on computing machinery and data processing. O’Reagan’s (1969) analy- 
sis gives evidence for the cost benefits of similar automatic data editing 
procedures when the alternative procedure is manual correction. 

The Reliability of Freshman Survey Items 

As part of the Cooperative Institutional Research Program (CIRP), each 
annual cohort of freshmen entering participating institutions completes a 
four -page survey questionnaire. This instrument is designed to elicit responses 
to a broad range of items presented in multiple choice of checklist formats, 
and requires about 25 minutes to complete. The completed questionnaires are 
readily processible by an optical scanner, which senses the respondents’ 
answer marks and records them in coded form on a magnetic tape for ^urther 
analysis with an electronic computer. Such procedures enable the processing of 
data from a nationwide sample of approximately 300,000 respondents each year. 
About one-third of the items are repeated from one survey to the next , an- 
other third appear less often, and the final third are new in a given survey. 
This arrangement provides both continuity for the assessment of trends and 
flexibility for the exploration of current issues in higher education. 

The pool of items used in a given year solicits information on the 
demographic and biographical characteristics of entering freshmen, their high 
school experiences and activities, their academic and career plans, their life 
goals and aspirations, and their attitudes toward various political and aca- 
demic issues. Since our aim in this study was to obtain estimates of the 
reliabilities of all freshman survey items used in questionnaires for the four 
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cohorts — 1966, 1967, 1968, and 1969 — the 1969 Student Information Form 
(SIF) was supplemented with a special form consisting of those items in prior 
surveys which had not been repeated in the 1969 form. A copy of the 1969 
SIF appears as Appendix A; a copy of the supplemental form appears as Appendix 
B. 

Sampling, Administration, and Processing 

Although we had originally planned to conduct the study with a subsample 
of institutions participating in a regular survey, and to use the actual data 
from this survey as the pretest data, thus making the retest as similar as 
possible to actual survey conditions, this plan proved to be impractical 
financially and logistically. Therefore, we administered the two questionnaires 
(the 1969 SIF and the Supplemental SIF) to second-term freshmen at three insti- 
tutions, none of which were participants in the 1969 survey: the groups were 

retested two to three weeks later. The three institutions included a state 
university (N*97) , a private university (N*62) , and a community college (N*43) 
located in the metropolitan area of Washington, D.C. Hatching test-retest 
protocols were obtained from 202 students; however, response rates for individual 
items ranged from 195-202. All but three of the students were Caucasian, thus 
precluding any systematic study of racial differences in stability of response. 
Students who completed both tne test and the retest questionnaires were paid a 
small honorarium for their participation. Subjects were obtained through in- 
stitutional cooperation for making testing facilities available and by inform- 
ing students of the study through posted notices and announcements in the stu- 
dent newspaper . 

The sample was small and somewhat biased, and the testing was carried out 
after the freshmen had been in college for more than one term, in contrast to 
our usual practice of surveying entering freshmen during the registration or 
orientation period. Nevertheless, these conditions were probably adequate to 
ensure useful estimates of item reliability. The sample can be characterized 
more fully by noting that the institutions participating in this study were 
neither very selective nor very affluent. The subjects were predominantly 
white students from the urban areas in the eastern and southern regions. Com- 
pared with the national population of freshmen entering college in 1969 
(Creager, et al.), the students participating in this study had typical high 
school grades, but a larger proportion ranked in the top quarter of their high 
school graduating classes; in addition, their parents were somewhat more highly 
educated and the family somewhat more affluent. 
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Stability of Response as a Function of Item Content and Form 

Estimates of the reliability of survey items obtained from the 202 fresh- 
men in this study are presented in a series of tables, of which there are two 
major types: in the first, distribution statistics for both test and retest, 

as well as the reliability coefficients are presented for blocks of items 
similar in form or content; in the second, the bivariate (i.e., test-retest) 
percentage distributions are presented for selected single items. The first 
type enables easy comparison of reliabilities for items covering a given area 
or presented in a certain form. The second type illustrates the actual devi- 
ations from retest regression and variations across item categories; rows are 
defined by pretest categories and columns are defined by posttest categories. 
Generally, these bivariate tables show that the test-retest regressions are 
rectilinear and homocedastic. 

The test-retest statistics and reliability coefficients for demographic 
characteristics, family background, high school achievements, and college ad- 
missions items (presented in Table 1) proved to have the expected high sta- 
bility. Most of the reliabilities were so close to 1*0 that corrections for 
measurement errors are probabi not needed when such variables are used in 
analysis. One exception was the item dealing with the student * s concern about 
financing his college education, which had an £ of .85. This item and the 
item on age are the only ones in the block for which the true score can change 
with the passage of time; any response variability in the other items is 
probably attributable to faulty recall or to carelessness in reading and marking 
the questionnaire. When the respondent is asked to indicate his age as of a 
specified date, as he was, only the means and standard deviations should change 
at that date. When he is asked to give his age as of the date of testing, or 
at his nearest birthday, more short term variability in response is to be ex- 
pected. Concern about financing one’s education can, however, alter at any 
time. This item has three alternative response categories; the other items in 
this group have from six to nine categories. Similar reliability estimates 
(•85— .88) were observed for the block of items on sources of financial sup- 
port during the freshman year (Table 1C, which also have three alternatives. 

The bivariate plots shown for these items in Tables 2-8 are just what 
one would expect given such high reliabilities; the few deviations observed 
between test P’ld retest data were largely confined to shifts to an adjacent 
category. For such variables as reported annual income of the parents, 
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appreciable skewness in the distributions, similar in degree and direction, 
appeared both on test and retest: This is apparently a characteristic of the 

true score distributions rather than the result of random sampling errors. The 
bivariate plot for the region of birth, generated from the student’s reported 
state of birth, is shown in Table 9. The overall test-retest concordance for 
the region categories is 98 percent, the values for individual regions ranging 
from 96 percent to 100 percent. 

Reliability data are not presented for either the sex or the racial/ethnic 

items. No valid estimate of the reliability of the sex item could be obtained 

3 

for the total sample because of an experimental error. There is, however, no 
reason to believe that the sex item would be any less reliable under normal 
conditions of questionnaire administration than were the other demographic 
variables. Any response variation on this item is most likely to be a function 
of sporadic carelessness in marking the survey form. 

In the case of the racial/ethnic item, no estimate of reliability was 
possible because only three blacks were included in the sample, and other 
racial/ethnic groups were not represented at all. Investigating the reliability 
of this kind of item and particularly its sensitivity to the number and semantic 
form of the response alternatives* Bayer (1971) found that a properly constructed 
item can have a short-term retest concordance of 98 percent or higher. If 
carelessly constructed, however, such an item may result in very serious errors 
in identifying racial/ethnic subgroups; any special analyses or comparisons 
based on such fallible data can lead to very misleading inferences. The item 
is not one on which the true score can vary, if the racial/ethnic categories 
have any absolute meaning beyond the culturally determined semantics of self- 
identification. Hence, response variability is primarily a l iction of item 
structure, over which the researcher has some degree of control and, there- 
fore, responsibility. 

In the area of academic aspirations (e.g., degree plans, probable major 
field, and career plans), short-term retest resulted in nearly perfect concor- 
dance. The sporadic examples of discordant response appear to be attributable 

At two of the institutions, students were told that they could use 
aliases, provided that they were the same on both the test and retest forms. 

Of those who did so, some used names associated with the opposite sex and were 
inconsistent in whether they checked their true or fictitious sex. The esti- 
mate of reliability for 60 students in the third institution, where real names 
were used was .96. 
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to careless marking of the survey form. Considerable changes have been reported 
in the response to these items over the longer period of the freshman year 
(Bayet , Drew, Astin, Boruch, Creager, 1970) and these changes differed accord- 
ing to the type of college attended. In view of the high concordance of re- 
sponse in the present reliability study, the changes observed over the entire 
freshman year are very convincing and are most likely to be a function of the 
college experience. 

With the exception of the concern for financing one’s education, and 
reported sources of financial support, the reliabilities of the items consi- 
dered so far were sufficiently high that unity may be reasonably placed in 
their associated diagonals in correlation matrices. Even though no variable is 
perfectly reliable, it should be recalled that corrections for attenuation in- 
volve the square roots of the reliabilities and that the values obtained for 
the reliabilities are themselves estimates subject to sampling errors. For the 
remaining variables considered in this study, reliability estimates should be 
used in the diagonals of correlation matrices for regression or components 
analysis.^ In some cases, such replacement of diagonal values may result in 
some side correlations of unity or greater, in which case one of the offending 
variables should be eliminated, or the highest uncorrected side correlation 
used as a better estimate of reliability. In this connection, computer soft- 
ware permitting a test of matrix singularity, rearrangement, or elimination 
of variables may prove useful (Boruch and Dutton, 1970). 



In the case of dichotomous variables generated from the responses to a 
single category, the reliability as measured by the Phi coefficient is a func- 
tion of the base rate, i.e. , the frequency with which that category is checked. 
This, in turn, is not independent of the number of, and base rates for, the 
other categories. Hence, the Phi coefficients may be low even when there is a 
high concordance on retest. The Phi/Phi max coefficients, which allow for the 
variation in base rates, are much higher and more consistent across categories, 
but have the disadvantage of representing an intrinsic relationship rather 
than one which is practical in correcting for attenuation in correlational 
analysis (Guilford, 1950). 

^Communality estimates should be used for common factor analysis. The 
equivalent replacement of unit diagonal values may be accomplished by pre- and 
post-multiplication of the observed correlation matrix by a diagonal matrix 
containing the replacement values (reliabilities or communalities) , prior to 
the correlational analysis. Some generalized regression programs for compu- 
terized analysis include this option. Many, however, do not and thus do not 
function properly without unit diagonals. 
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In contrast to the high reliabilities so far noted, responses to items 
on attitudes and opinions, life goals, and the estimated chances of future 
behaviors were considerably less stable (Tables 11-15) . When students were 
asked to report on certain attributes of their parents, the reliabilities were 
in the range of .60-. 82 (Table 11). One likely source of this response in- 
stability — beyond the fact that the student was asked about "what is inside 
the head (or heart) "of others — is that the attributes as perceived may be 
different with respect to the father and mother; in this case, what does the 
respondent do, when asked to characterize his parents as a unit: report for 

one parent on test and the other parent on retest? Or give a differently 
weighted average on each of the two occasions? Asking for a single response 
about both parents is faulty item construction; either ask about one speci- 
fied parent, or allow separate responses for each parent. 

Reliabilities for students’ estimates of the probability of certain fu- 
ture events occurring, (Table 12) ranged from .58 to .88. The response sta- 
bility was clearly a function of the event: e.g., unstable for expecting to 

drop out of college temporarily, but fairly stable for expecting to transfer 
to another college, possibly because two-year students who plan to go on to a 
four-year institution were included in the sample. Response stability was 
lower for those events which are dependent chiefly on the actions of others: 
e.g., being elected to a student office, getting an article published, gradu- 
ating with honors. It was highest for getting married while in college, join- 
ing a fraternity or sorority, and for protesting over various issues, all 
actions that are more under the control of the respondent. The reliability 
of the protest items is considered in greater detail in a later section of this 
report. The reliabilities of students’ reports of the life objectives they 
considered to be essential or very important (Table 13) ranged from .65 to .87 
and again varied with the nature of the specific objective. They tended to be 
higher for such goals as raising a family, being well-off financially, keeping 
up with political affairs, and being creative in the arts. The lower value 
for developing one’s life philosophy is probably a function of its high popu- 
larity (i.e., base rate). In this connection it should be noted that items 
which have lower stability as a function of extreme base rates may neverthe- 
less be important and useful in research. 

Attitude and opinion items have lower average response stabilities and 
more variable estimates across items, both for attitudes toward Federal 
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involvement in various social and economic areas (Table 14) and their attitudes 
toward various academic and social issues (Table 15) • Many freshmen enter 
college with limited awareness of, and information about, or even interest in, 
many of the issues. Some, perhaps, remain uninterested and uninformed; many 
other students may develop rapidly in these respects, especially during their 
early encounters with other students from widely different backgrounds. Thus, 
despite their modest reliabilities, attitude items have considerable value 
for a longitudinal research program in which college experiences are hypothe- 
sized to help a person become more aware of, and better informed about, such 
issues. Given this degree of instability responses of freshmen to these 
items, it is necessary to make an independent estimate of the reliability of 
their responses to these items when they are reported in the followup surveys. 
Only if this is done can the college effects on reliability be separated from 
effects on mean attitude changes.^ 

Phi coefficients for checklist items of secondary school achievements 
(Table 16) , scored as dichotomies, were uniformly high, despite low base rates 
for most of the items on the list. For two of them, participating in a Na- 
tional Science Foundation summer program and winning in a state or regional 
science contest, the base rate in the sample was too low even to permit an 
estimate. The relatively high reliability of the remaining items probably re- 
sulted from asking the student for objective information about his past in con- 
trast to asking him for subjective judgments or about future plans and expec- 
tations. 

Freshman reports about their current and future political preferences as 
indicated on a scale of five ordered categories were extremely high and nearly 
identical in their concordance, patterns (Tables 17-18). Here we do not ob- 
serve the drop in reliability usually associated with future-oriented items. 

In this case, other available data show that there is an actual shift toward 
the political "left" during college, both within and between class years. 



The reliability of responses to followup surveys conducted by mail is 
important in the analysis of panel data and generally more difficult to es- 
timate than in the case of the freshman surveys. For many of the items re- 
peated in followup surveys, the estimates from the freshman survey would seem 
to be reasonable ones to use in the absence of independent estimates. This 
notion becomes more tenuous, however, the lower the estimate from the freshman 
survey, and, as noted above, can be misleading in the case of items on atti- 
tudes, opinions, and expectations. 
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(For several supporting references, see Bayer, As tin, and Boruch, 1971.) 

Again, the high reliability of the input data strengthens the conviction that 
these longitudinal changes are changes in true scores, not artifacts of 
measurement error. 

The Stability of Self-Reported Protest Activity and Attitudes^ 

Because of recent special interest in campus unrest, the Council’s Office 
of Research has not only conducted a number of studies in this area but also 
has included in the Student Information Form items on protest activity in 
high school, and on attitudes toward college administrative controls over stu- 
dent life; a self-rating of liberalism has also been included. This section 
documents the response stability of such items in greater detail, to provide 
a rough picture of the nature and extent of measurement error in research on 
protest activities. 

Students were asked to indicate whether they had participated "frequently” 
(coded ”3"), "occasionally” (coded "2”), or "not at all” (coded "3") in high 
school protests against three policies: racial or ethnic policies, military 

policies, or high school administrative policies. Mean scores and standard 
deviations for test and retest, along with correlations between test and re- 
test, are presented in Table 19. The columns headed A^-l an< ^ 
are the algebraic differences between pretest and posttest means and standard 
deviations, respectively. 

Judging from the correlation coefficients, and bearing in mind that the 
subsamples were small, the freshmen from the public institutions (1 and 3) 
were most likely to change their reports about participation in a high school 
demonstration against the school administration; the test-retest reliability 
was rather low for both the state community college (.29) and the state uni- 
versity (.36). The highest reliability (.59) occurred for students at the 
private university. Either these students were more certain about the extent 
of their involvement, or they were simply more consistent in their interpre- 
tation of the word administrative. 

The most stable responses were elicited by the question about protest 
against military policies. Reliabilities are quite high, ranging from .76 to 
.93. The reason for the high reliabilities may be the unique and unambiguous 



^The data and discussion portions of this section have been combined with 
sampling information from an earlier section and are being published separately 
(Boruch and Creager, 1972). 
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character of a protest against the Vietnam war, the draft, and related issues. 
Protests over racial issues were characterized by an intermediate range of 
reliabilities, from .54 to .74. 

Typically, changes in mean response irom test to retest are nonsignifi- 
cant for the students given the option of using aliases (the state and private 
university groups). In the community college sample, however, the frequency 
of reported participation in high school protest decreased systematically, 
rather than being random (and, thus perhaps, attributable to carelessness in 
filling out the questionnaire) . 

Since it seems likely tha*: students will tend to give an innocuous answer 
when the report concerns behavior that might be used against them, this de- 
crease In reported participation probably indicates that they had second 
thoughts between test and retest about the risk involved in indicating to out- 
siders that they had engaged in protest. 

Freshmen were also asked to estimate the likelihood of their participating 
in a protest against each of the same policies at some time while in college. 
Four alternatives were given, ranging from "very good chance” (coded ”4") to 
”no chance" (coded "1") . The findings are given in Table 20. 

The test-retest correlations were systematically higher for all three in- 
stitutional samples and for all three protest issues than was the case for re- 
porting participation in protest activity in high school. Given the widely 
different likelihoods of participation (as indicated by the within-college 
means), this stability is encouraging* Homogeneity was also evident in the 
test-retest means and standard deviations. Despite some college differences, 
the difference in test-retest averages for any given type of protest was in- 
significant. The systematic, if nonsignificant, decrements in average means, 
suggest that some students in each group tended to change their initial re- 
sponse to a more innocuous one (i.e., less likely to participate in a protest). 

Table 21 contains data on a variety of issues that are associated with 
student freedom and with campus protests. The SIF items on which these data 
are based included a four-point self-rating of liberalism, a five-point item 
on Federal control of student activism, and four -point agree-disagree items on 
statements that should regulate activities of off-campus students, should 
regulate publications and should maintain veto power over campus speakers; the 
final agree-disagree item states that college administrators are too lax in 
dealing with campus protesters. 
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For a given attitude item, response stability did not differ significantly 
among the institutions, except for the statement concerning administrative con- 
trol of activism. The students at the public university were less consistent 

8 

on this item than were the students at the other two institutions. Assuming 
the equality of correlations across colleges, the weighted averages of correla- 
tions for each item except administrative control of activism are: 

Liberalism T ■ .65 Regulate publication Y * .57 

Ban speakers Y * .65 Regulate off-campus 

behavior Y * .52 

Administra- 
tive laxity Y ■ .65 

Testing for equality of all these estimates except the liberalism rating, we 
find that differences among estimates are only of marginal significance. That 
is, choosing a confidence level of .05 leads to rejection of the null hypothe- 
sis but using .025 provides no evidence for rejection. The stability of self- 
ratings of liberalism was significantly higher than that of the other items. 

The attitudes toward banning controversial speakers from campus and adminis- 
trative laxity in dealing with protest appeared to be slightly more stable than 
did attitudes about regulating student publications and regulating the off- 



campus behavior of students* 

The freshmen in this sample were generally most stable in self-ratings of 
their liberalism. With one exception, previous participation in high school 
protests were likely to be reported more erratically (from test to retest) when 
the issue was administrative policy. Reports about participation in military 
protests were the most likely to be stable. 

Agreement with statements endorsing the college's right to ban extremist 
speakers, to regulate students' off-campus behavior, and to control student 
publications, and about lax treatment of student protests was fairly stable, 
but generally lower than liberalism ratings. With respect to Federal control 
of student activists, the degree of response stability seems to depend some- 
what on the particular institution attended by the student. 

These data may help to explain certain anomalies in the recent research 
literature. For example, in a study using identical questions and similar 



^Snedecor and Cochran (1967) provide a test of the hypothesis of the 
equality of sample correlations. For the statement concerning administrative 
control of activism, X 2 - 11.7 is significant at the .025 level. 
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groups of students <N * 4,000), Astin (1968) dealt with the prediction of col- 
lege protest from high school protest activities. His prediction equations 

o 

were best for protests over military policy (II = .18) and worst for protests 

2 

over administrative policy (R * .08). From the current data, we may conclude 
that the differential predictability may be caused, at least in part, by 
differential response stability rather than by random sampling variability in 
the regressions. 

The Accuracy and Precision in Self-Reports of Grades and Age 9 

Research on college students frequently relies heavily on self-reports of 
grades and age. The research literature typically suggests that, for con- 
tinuous scales and relatively stable conditions, the overall reliability of such 
self-reports is in the 80-100 percent range. In many analyses, however, stu- 
dents are classified into strata or matched on the basis of the self-reports, 
in which case the reliability of the specific classification, rather than 
overall reliability, is most crucial. To investigate the accuracy and pre- 
cision of such classification, additional analyses have been conducted on 
longitudinal survey data and registrar records from the Council’s CIRP. 

The data for these analyses were obtained from a different sample than 
that used in the reliability study reported in the two preceding sections. 

The sample consisted of 4,415 students who enrolled as freshmen from a stra- 
tified sample of 246 two-year and four-year colleges and universities in the 
fall of 1966, and who also participated in a mailed followup survey in the 
summer of 1967. College registrars supplied additional data on these same 
students. 

Self-Reports of Freshman Grades 

During the summer following their freshman year, students reported their 
grade-point averages by checking one of eight alternatives: D, C- and C, C+, 

B-, B, B+, A-, A and A+. The grades recorded on the registrars’ reports were 
classified into the same eight levels. 

To determine the nature of error in reporting, two criteria were con- 
sidered: the accuracy of reporting within each grade stratum and the 



Q 

The material in this section was presented at the annual meeting of the 
National Council on Measurement in Education, February 6, 1971, New York. 
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correlation between the students’ reports of their grades and the registrars’ 
reports of the same grades. The first criterion reflects the extent to which 
students bias reports systematically in one direction rather than another. 

The second reflects the agreement between self-repcrts and records, as well as 
any unsystematic variability in self-reports. 

Table 22 shows the proportions of men and women reporting grades in each 
of the eight strata and the proportions of those at each grade level, accord- 
ing to registrars' records. The biases were small in absolute terms but 
notable when compared with the actual percentage of students in a given cell. 
Men were more likely than women to report higher grades than they actually re- 
ceived, and this tendency was particularly evident for the A- and B+ strata. 
Although there were biases in the A/A+ category, the same proportions of men 
and women tended to be too modest in their self-reports of high grades. Among 
women, systematic bias in reporting grades was negligible at some grade levels, 
notably in the C range. 

The sample included a small proportion of black students; data for 64 
black men and 86 black women are presented in Table 23. Although there is 
some indication of greater bias for blacks of both sexes at the lower grade 
categories, these data were subject to much larger sampling errors so that none 
of the observed biases were statistically significant. 

Relations between self-reported grades and those recorded in administra- 
tive records are presented in Table 24, separately by sex for the total sample 
and for the subsample of black students. These relations are expressed in 

correlational form as the ratio of Phi to Phi , thus providing an index of 

max 

the veracity of self-reports relative to the maximum value Phi can have 
(Guilford, 1950). The overall correlation between actual grades and reported 
grades, not shown in the table, was .88, and was the same for men and women. 

The reports of students who actually performed at the A/A+ level were most 
likely to be accurate, and the reports of those in the B, B-, and C+ strata 
were least reliable. Generally, men were somewhat more likely than women to 
give systematically biased reports of their grades, while women were more 
likely to give unsystematically biased reports. The data for black students 
are based on such small numbers within grade categories that the statistics 
are too unstable for any fine interpretation. 

To summarize, biases in self-reports of freshman grades depend on the 
grade average actually achieved and, to some extent, on the sex of the student. 
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Research on a much larger sample of black students is needed to verify the 
racial differences in reporting grades, suggested by the data on the small 
sample of blacks in this study. The overall veracity of self-reported 
grades (.88) is sufficiently high to justify their use as a proxy measure when 
actual grades are not available. 

Self-Reports of Age 

The students reported their birth dates on the 1966 SIF. In response 
to a separate inquiry, they gave their ages "as of December 31, 1966.” Re- 
search with twins* reports of their birth dates indicates that birth dates 
constitute a true score, if one deletes the few who inadvertently give the 
current year rather than the year of birth; thus, the veracity of self-reported 
age can be assessed. To compare reported age with "actual" age, the date of 
birth was transformed to decimal form and subtracted from the decimal equiva- 
lent of December 31, 1966. Seven levels of age were considered, from 16 years 
or younger to 22 years or older. 

Bias in self-reports of age is shown for each age level, separately by 

sex, in Table 25. It is evident that systematic differences between reported 

and computed age were insignificant. Random variability was found, however, as 

is reflected in the imperfect ratios of Phi to Phi presented in Table 26. 

max 

There were no systematic differences found between black and nonblack students 
for these statistics on age. 

Reported age was generally congruent with true age at all levels except 
the oldest. Women of 22 years or more were typically more random in their 
responses than were men of the same age level. The overall correlation be- 
tween reported age and date of birth was somewhat higher for men (.91) than 
that for women (.85). Reported age is, therefore, a satisfactory proxy 
measure for actual age and does not require the conversion for correlational 
analysis that must be made when the information is obtained as "date of birth." 

To summarize, self-reports of age are sufficiently accurate for matching 
and stratification purposes. No biases in proportions of students reporting 
a particular age were substantial. The extent of agreement between self -re- 
ported age and age computed from birth date was high, the only exception 
being that women of 22 years or older were somewhat likely to check younger 
age categories. 

The researcher carrying out local studies can use the statistics pre- 
sented here to estimate the true proportion of students who accurately report 
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their own age and grades. Cochran (1968) has presented equations for cor- 
recting sample proportions and these corrections can easily be generalized to 
2x2 cross-tabulations and analysis. Cochran* s equations require estimates 
of the proportion of false positives (i.e., erroneous affirmations) for a given 
self-report (e.g., an A+) and the proportion of false negatives (i*e., the 
proportion of students who actually made A4* averages, but reported a lower 
average); the statistics provided in Tables 22-26 should be sufficient for 
some of these estimates. 

Errors in Initial Data Files: Verified 

Keypunching Vs. Optical Scanning 

Even when item responses adequately represent "true scores by meeting 
all the requirements of consistency, veracity, and stability, error may creep 
into the process of converting response marks on the measuring instrument to 
machine-processible form. Such error may be either random or nonrandom. To 
the extent that it is random, its effects on inferences drawn from analyzed 
data are indistinguishable from randon instability of response. Thus, random 
error in data processing is part of the reliability problem, even though it 
arises from the behavior of the investigator (and his staff), rather than 
from that of the survey respondents. 

Verified keypunching, while not absolutely error-free, introduces little 
error into the data actually processed, and punched cards can normally be 
read into a computer either directly or onto magnetic tape with negligible 
error rates. 

With questionnaires cast into objective format, the processing of data 
from large-scale surveys can be more efficiently handled by optical scanning 
devices, which sense a respondent’s answer marks and convert them into coded bit 
configurations on magnetic tape. Most of the survey data obtained in the 
Council’s CIRP are so processed. The hazards involved in optical scanning 
include programming errors, nonreadable responses, and variations in the 
alignment of questionnaires being fed through the scanner. Programming errors 
usually result in systematic errors in the data but can be virtually eliminated 
with due care. Nonreadable questionnaires which result in loss of informa- 
tion, either on individual items or on entire respondent records can be re- 
duced to negligible proportions if proper instructions are given to the 
respondent and if the administration of the forms is adequately proctored. 
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The maintenance of consistent alignment of the questionnaire response posi- 
tions with the corresponding photoelectric cells programmed to sense speci- 
fic responses is, critical for accurate data processing. Frequent checking 
by the operator is required to detect nonalignment. Verification by re- 
scanning and programmed diagnostics on output from the scanner-computer com- 
plex are also useful for detecting such problems. 

Usually, some coding of the responses is required. Unless the question- 
naire is self-coding or precoded, coding normally precedes keypunching. In 
optical scanning, the coding is programmed in accordance with user specifi- 
cations. In either case, coding should be exhaustive, and due allowance must 
be made for multiple responses and nonresponses. Otherwise, both random and 
nonrandom errors can be introduced into the observed scores. 

Most studies of measurement error do not distinguish between that term 
and initial processing error, confounding the two on the assumption that the 
latter is either negligible or random. When this assumption is false, re- 
ported reliabilities do not have their classical meaning. If processing errors 
are random, it is pragmatic to combine them with random response variations 
when 'Correcting for attenuation." Nevertheless, processing error is probably 
more readily reduced, if not entirely eliminated, than is response variability, 
and indeed, there is little excuse for more than rare, sporadic errors in data 
processing. 

Verified keypunching and optical scanning were compared using the 1969 
SIF data collected during the initial testing of 191 of the subjects who par- 
ticipated in the study of the reliability of survey items. All questionnaires 
were first keypunched for use in the analysis of retest reliability: coding 

was accomplished directly at the keypunch, since most items are essentially 
precoded in a systematic way for each item format. Then the 1969 SIF ques- 
tionnaires used in the pretest were optically scanned, using the same coding 
specifications as those used during the 1969 fall survey of entering freshmen 
(CIRP) . 

Correlations between item scores obtained from the two methods of pro- 
cessing are presented in Table 27. As expected, they are very high but they 
do not indicate perfect agreement. A spot-check against original protocols 
revealed no errors from the well-debugged optical scanning procedure. Prac- 
tically all the discrepancies were attributable to the keypunching operations. 
When format changed as a new group of items were punched, the discrepancy rate 
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tended to rise, and then to settle back into a pattern of small and occasional 
discrepancies, suggesting that many errors resulted not from the keypunching 
per se but from ’’coding at the keypunch.” Highest discrepancy rates (up to 
10 percent) were observed on the items asking for descriptions of the parents. 

On many items, however, there were no discrepancies, and the rates were of the 
order of 1 or 2 percent. Most of the keypunch errors were confined to adjacent 
categories and seemed to be nonsystematic. 

As a by-product of this study, some idea was obtained of the rate of 
missing data, including nonprocessible responses and omitted items, which never 
exceeded 5 percent of the subjects for a given item, and, most typically, was 
of the order of 1 percent. Data were missing more commonly in the case of the 
more sensitive items (e»g., income) or where the information sought might not 
be known or meaningful to the respondent (e.g., reporting about parents, 
stating expectations, having an opinion on certain issues). 

The general conclusion is that errors of measurement arise primarily from 
sources other than those associated with the initial coding and transcribing 
of item responses to machine-processible form, provided that reasonable pre- 
cautions and checks are incorporated into such operations. 

Concluding Remarks 

The major reason for concern about the reliability of survey measure- 
ments is that random errors in data may lead to false or misleading inferences. 
These random errors may occur either as response instability (error of measure- 
ment) or as errors in processing the data* In either case, inferential error 
may result from errors in the classification of observation units or from dis- 
tortions in a correlation matrix by differential attenuation of observed cor- 
relations. Although these principles are widely known, especially with respect 
to psychological tests and measurements, they are frequently ignored in social 
and educational research based on survey questionnaire procedures for collect- 
ing data. This report has presented empirical estimates of reliability for 
the kinds of variables typically used in the annual surveys of entering college 
freshmen conducted by the American Council on Education. 

Despite some limitations in the sample studied, these estimates are satis- 
factory for use in analyzing the survey data. The estimates may also be use- 
ful when analyzing panel data obtained by posttesting with the same variables 
in a followup study, and when independent estimates of the reliabilities of 
the followup measurements are not available. 
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Except for grossly awkward or otherwise inappropriate administrative con- 
ditions, the major factors determining reliability are the content and structure 
of item* For this reason, there may be some justification for relying on 
some of the reported reliability data in other surveys; wherever possible, how- 
ever, independent estimates of the reliabilities of survey variables should be 
obtained. The substantive content of an item must be relevant and meaningful 
to the entire heterogeneous population of respondents, a condition that re- 
quires a compromise between sufficient generality to ensure that heterogeneity 
is represented in the response possibilities, and sufficient clarity to ensure 
that any given response will be interpre table. Moreover, the various response 
alternatives in a multiple— choice item must be both exhaustive and mutually 
exclusive. The semantic content of an item is critical for both veracity and 
stability of response: not only must the vocabulary be basic enough for all 

respondents to understand what is being asked (note, e.g., the difficulties 
some freshmen have with a term like Caucasian) , but individual terms must carry 
a common meaning to all the subpopulations being queried. 

Generally, an increase in the number of meaningful response alternatives 
in a multiple-choice item increases reliability and results in more homogeneous 
interpretability of the responses to any one alternative. In the case of 
ordered categories, however, a point of diminishing returns may be reached 
rather quickly as the respondent is required to make finer discriminations. 

In a checklist item in which each subitem results in a separate dichotomous 
variable, considerable variation in reliabilities may be expected as a func- 
tion of the base rates (popularities) of various subitems and of the probabili- 
ty that subjects will respond to more than one subitem in the list. 

Reliabilities of items also vary as a function of their content . Consis- 
tently, in this and in previous studies, objective items asking for information 
about the respondent, especially demographic and family background information, 
had high reliabilities as did items asking for academic and career plans and 
aspirations. This is fortunate in that many analyses of survey data involve 
breakouts in terms of the categories in such items. In addition, items asking 
the respondent to recall verifiable facts about his recent activities and 
achievements generally have high reliabilities. Lower reliabilities are 
typical .of items asking the respondent for his attitudes and opinions or for 
his perceptions of his parents 1 characteristics. Generally lower reliabilities 
are also associated with items that depend upon the behavior of others and for 
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items oriented toward future events (e.g., goals and expectations), though in 
the latter case, reliability varied considerably for various specific future 
events . 

With rare exceptions, the reliability data obtained in this study indi- 
cate that all of the variables considered are sufficiently reliable for analy- 
tic use in statistical research, and many of them are sufficiently reliable 
that inferences drawn from analyses taking measurement errors into account 
can be used in institutional decision making and in counseling students. 
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Table 1 

Test-Retest Statistics and Reliabilities for Items 
on Demographic Characteristics, Family Background, 
High School Achievements, and College Admissions 



Item 






S .D. ^ 


*2 


S»D»2 


Age 




4.23 


.89 


4.24 


.94 


.96 


Father's education 




4.12 


1.41 


4.12 


1.41 


.99 


Mother * s education 




3.65 


1.08 


3.63 


1.08 


.97 


Estimated parents’ income 




6.11 


1.89 


6.15 


1.88 


.98 


Concern about financing college 
education 




1.65 


.62 


1.56 


.58 


.85 


Average high school grade 




4.90 


1.64 


4.88 


1.64 


.98 


Rank in high school class 




3.24 


3.46 


3.34 


3.53 


.97 


Number of applications to 
other colleges 




3.02 


1.72 


3.01 


1.75 


.98 


Number of acceptances by other 
colleges 




2.35 


1.33 


2.32 


1.34 


.97 


Distance of college from home 




2.72 


3.03 


2.69 


3.02 


.97 




Table 


2 










Bivariate Distribution for 


Stability of Reported Father’s 


a 

Education 














Row 


Father’s Education 


1 


2 3 


4 


5 


6 Percentage 


1 Grammar school or less 


3.5 










3.5 


2 Some high school 




8.9 1.0 








9.9 


3 High school graduate 




1.0 21.8 








22.8 


4 Some college 






18.8 


1.0 




19.8 


5 College degree 








23.2 




23.2 


6 Postgraduate degree 








1.0 19.8 


20.8 


Column Percentage 


3.5 


9.9 22.8 


18.8 


25.2 19.8 


100.0 


a In these and all subsequent bivariate tables, rows refer to test data 


and columns refer to retest data. 














Table 
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Bivariate Distribution for 


Stability of Reported Mother’s 


fit 

Education 














Row 


Mother’s Education 


1 


2 3 


4 


5 


6 Percentage 


1 Grammar school or less 


1.0 










1.0 


2 Some high school 




7.0 0.5 








7.5 


3 High school graduate 




1.0 46.0 








47.0 


4 Some college 




0.5 


20.0 


0.5 




21.0 


5 College degree 




0.5 


1.0 


15.0 


0.5 


17.0 


6 Postgraduate degree 








0.5 


6.0 


6.5 


Column Percentage 


1.0 


8.0 47.5 


21.0 


16.0 


6.5 


100.0 



ERIC 
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Table 4 

Bivariate Distribution for Stability of Estimated Parents’ Income 





Estimated Parents’ 
Income 


1 


2 


3 


4 


5 


6 


7 


8 


Row 

9 Percentage 


1 


Less than $4,000 


1.0 
















1.0 


2 


$4,000 - $5,999 


0.5 


3.0 














3.5 


3 


$6,000 - $7,999 




0.5 


3.0 


0.5 










4.0 


4 


$8,000 - $9,999 








4.5 


1.5 








6.0 


5 


$10,000 - $14,999 










21.5 


3.0 




0.5 


25.0 


6 


$15,000 - $19,999 










0.5 


21.5 


1.0 




23.0 


7 


$20,000 - $24,999 












0.5 


11.0 


0.5 


12.0 


8 


$25,000 - $29,999 














1.5 


8.5 


10.0 


9 


$30,000 Or more 


















15.5 15.5 




Column Percentage 


1.5 


3.5 


3.0 


5.0 


23.5 


25.0 


13.5 


9.5 


15.5 100.0 










Table 5 














Bivariate Distribution for Stability of Reported Concern 
About Financing College Education 




Concern About Financing Education 




1 


2 


3 


Row 

Percentage 


1 


None 










40.3 


2.0 






42.3 


2 


Some 










6.5 


43.3 






49.8 


3 


Maj or 












3.5 


4.5 




8.0 




Column Percentage 










46.8 


48.8 


4.5 




100.0 










Table 6 














Bivariate 


Distribution for Stability of 
Average High School Grade 


Reported 






Average High 
School Grade 


1 


2 


3 


4 


5 


6 


7 


8 


Row 

Percentage 


1 


A or A+ 


4.0 


0.5 














4.5 


2 


A- 


0.5 


9.9 


0.5 












10.9 


3 


B+ 




1.0 


16.8 


2.5 










20.3 


4 


B 






1.5 


28.2 


2.0 








31.7 


5 


B- 








1.0 


11.9 


0.5 






13.4 


6 


C+ 












7.9 


0.5 




8.4 


7 


C 












1.0 


6.4 


0.5 


7.9 


8 


D 














0.5 


2.5 


3.0 




Column Percentage 


4.5 


11.4 


18.8 


31.7 


13.9 


9.4 


7.4 


3.0 


100.0 
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Table 7 

Bivariate Distribution for Stability of Reported 
Rank in High School Class 





Rank in 

High School Class 


1 


2 3 


4 


5 


6 


Row 

Percentage 




1 


Top 1 percent 


1.6 


0.5 






0.5 


2.6 




2 


Top 10 percent 




25.1 0.5 


1.1 






26.7 




3 


Top Quarter 


0.5 


28.3 


1.6 






30.1 




4 


Second Quarter 




0.5 1.1 


20.3 


0.5 




21.4 




5 


Third Quartet 






1.1 


12.3 




13.4 




6 


Fourth Quarter 








0.5 


3.7 


4.2 






Column Percentage 


2.1 


25.7 30.5 


24.1 


13.4 


4.3 


100.0 










Table 8 














Bivariate Distribution for Stability of 
Distance of College from Home 


Repor ted 








Distance of College 
From Home 


1 


2 3 


4 


5 


6 


Row 

Percentage 




1 


10 or fewer miles 


24.6 










24.6 




2 


11-50 miles 


1.6 


27.3 1.1 




0.5 




30.5 




3 


51-100 miles 




4.9 








4.9 




4 


101-500 miles 




0.5 


32.8 






33.3 




5 


501-1,000 miles 






0,5 


2.7 




3.2 




6 


1,000 or more miles 






0.5 




2.7 


3.2 






Column Percentage 


26.2 


27.3 6.5 


33.8 


3.2 


2.7 


99.7 




Table 9 



Bivariate Distribution for Stability of Reported 

Region of Birth 3 





Region of Birth 


1 


2 


3 


4 5 


6 


Row 

7 Percentage 


1 


Midwest 


69.5 






0.5 




70.0 


2 


New England 




2.0 








2.0 


3 


North-C entral 






8.5 






8.5 


4 


Northwest 








0.5 




0.5 


5 


Southern 


0.5 






12.5 




13.5 


6 


Western 










3.0 


3.0 


7 


Foreign Country 


0.5 










2.0 2.5 




Column Percentage 


70.5 


2.0 


8.5 


0.5 13.0 


3.0 


2.0 99.5 



98 percent concordance. 
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Table 10 

Test-Retest Statistics and Reliabilities 
for Four Reported Sources of Financial Support During Freshman Year 3 



Source of Financial Support 
During Freshman Year 


r i 


S.D. ^ 


*2 


s.d. 2 


£ 


Personal savings or employment 


1.82 


.69 


1.90 


.68 


.86 


Aid from parents or family 


2.52 


.77 


2.52 


.74 


.88 


Repayable loan 


1.23 


.58 


1.26 


.60 


.86 


Scholarship/grant/other gift 


1.41 


.73 


1.37 


.69 


.85 


For each source, the respondent was asked to 
(coded 3), minor (coded 2), or not a source (coded 


check whether it 
1). 


was major 




Table 


11 









Test-Retest Statistics and Reliabilities 
for Reported Attributes of Parents 



Attr ibutes 




S.D.j 


*2 


S *D • 2 


£ 


Interested in intellectual 
pursuits 


3.11 


.81 


3.09 


.75 


.71 


Interested in cultural 
pursuits 


2.94 


.75 


2.88 


.72 


.73 


Deeply religious 


2.40 


.82 


2.35 


.81 


.82 


Interested in politics 


2.95 


.64 


2.95 


.60 


.65 


Deeply concerned about 
children 


3.74 


.59 


3.75 


.57 


.73 


Financially comfortable 


3.21 


.75 


3.15 


.68 


.73 


Have high aspirations for 
respondent 


3 . 64 


.61 


3.64 


.55 


.60 



o 

ERLC 
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Table 12 

Test-Retest Statistics and Reliabilities 
for Reported Chances of Future Events 



Future Event 3 


*1 S.D.j^ 


*2 


s.D . 2 


£ 


Getting married while in college 


2.26 


.99 


2.27 


.97 


.88 


Marrying within a year after college 


2.84 


1.00 


2.84 


.98 


.82 


Obtaining average grade of A- or higher 


2.12 


.85 


2.14 


.87 


.77 


Changing major field 


2.84 


.93 


2.77 


.95 


.81 


Changing career choice 


2.82 


.99 


2.74 


.97 


.80 


Failing one or more courses 


2.31 


.93 


2.26 


.89 


.76 


Graduating with honors 


2.29 


.88 


2.23 


.85 


.73 


Being elected to a student office 


1.91 


.81 


1.98 


.79 


.73 


Joining a social fraternity or sorority 


2.39 


1.17 


2.34 


1.11 


.86 


Authoring a published article 


2.10 


.94 


2.04 


.90 


.76 


Being drafted while in college 


1.41 


.75 


1.48 


.75 


.80 


Being elected to an honor society 


2.17 


.92 


2.16 


.89 


.77 


Protesting over U.S. military policy 


2.70 


1.15 


2.63 


1.10 


.88 


Protesting over college administrative 
policy 


2.59 


1.01 


2.54 


.96 


.84 


Protesting over racial /ethnic policy 


2.72 


1.07 


2.61 


1.04 


.83 


Dropping out temporarily 


2.05 


.86 


1.95 


.82 


.69 


Enlisting in armed services before 
graduation 


1.18 


.51 


1.27 


.61 


.62 


Being more successful than average 


3.04 


.61 


3.07 


.60 


.59 


Dropping out permanently 


1.40 


.69 


1.45 


.69 


.58 


Transfering to another college 


2.67 


1.00 


2.62 


.99 


.82 


Alternate responses and scoring key: 
very little chance * 2; no chance - 1* 


Very good 


chance 


-4; some chance 


- 3; 


Table 


13 











Test-Retest Statistics and Reliabilities 
for Reported Objectives 



Obi ective 3 


x i 


s * D *i 


X 2 


s.d. 2 


£ 


Being accomplished in a performing art 


1.63 


.84 


1.78 


.90 


.78 


Being an authority in field 


2.82 


.81 


2.85 


.87 


.73 


Obtaining recognition from peers 


2.41 


.90 


2.47 


.88 


.68 


Influencing the political structure 


2.01 


.87 


2.03 


.86 


.72 


Influencing social values 


2.41 


.92 


2.43 


.87 


.71 


Raising a family 


3.08 


*98 


3.16 


.96 


.87 


Having an active social life 


2.74 


.89 


2.75 


.88 


.74 


Having friends different from self 


2.80 


.89 


2.85 


.85 


.70 


Being an expert In finance and commerce 


1.56 


.77 


1.63 


.83 


.74 


Having administrative responsibility 
for work of others 


1.90 


.86 


1.98 


.87 


.66 


Being very well-off financially 


2.45 


.85 


2.47 


.80 


.81 


Helping others in difficulty 


2.92 


.79 


2.84 


.81 


.65 


Becoming a community leader 


1.83 


.85 


1.91 


.81 


.74 


Contributing to a scientific theory 


1.37 


.67 


1.38 


.73 


.79 


Writing original works 


1.76 


.92 


1.80 


.98 


.80 


Not being obligated to people 


2.08 


1.03 


2.12 


1.00 


.71 


Creating works of art 


1.86 


.99 


1.89 


.94 


,81 


Keeping up with politics, iffairs 


2.74 


.83 


2.65 


.88 


.81 


Succeeding in own business 


2.05 


1.04 


2.16 


1.03 


.67 


Developing a philosophy of life 


3.35 


.83 


3.35 


.79 


.69 



Alternatives and scoring key: Essential * 4; very important » 3; somewhat 

important - 2; not important - 1, 
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Table 14 

Test-Retest Statistics and Reliabilities 
for Reported Attitudes Toward Federal Involvement in Problem Areas 8 




Problem Area 


x i 


S .D . 1 


X 2 


S * D * 2 


JL 


Control of cigarette advertising 


3.48 


1.13 


3.46 


1.10 


.73 


Elimination of violence from TV 


2.78 


1.17 


2.94 


1.15 


.64 


Control of pollution 


4.71 


.59 


4.64 


.64 


.43 


Control of birth rate through tax 
incentives 


3.22 


1.37 


3.27 


1.18 


.63 


Consumer protection 


4.14 


.73 


4.09 


.67 


.41 


Compensatory education for the 
disadvantaged 


3.98 


.79 


3.70 


.82 


.68 


Special benefits for veterans 


3.28 


.74 


3.19 


.72 


.58 


Control of firearms 


3.85 


1.05 


3.75 


1.04 


.79 


Elimination of poverty 


4.39 


.85 


4.27 


.82 


.69 


Crime prevention 


4.49 


.73 


4.36 


.69 


.44 


School desegregation 


3.83 


1.24 


3.75 


1.13 


.83 


Financial aid for disadvantaged 


3.67 


.88 


3.50 


.83 


.57 


Control of student activists 


2.55 


1.22 


2.53 


1.12 


.69 



3 

Alternatives and scoring key: Initiate new crash programs * 5; Increase in- 

volvement from current level * 4; Maintain current level of involvement * 3; 
Decrease involvement from current levels * 2; Eliminate any existing programs or 
remain uninvolved - 1. 



Table 


15 










Test-Retest Statistics and Reliabilities 
for Reported Attitudes about Campus and Social : 


Issues 3 






. I tem . 


X 1 


S.D., 


X 2 


S.D. 


2 £■ 


Students should help design curriculum 


3.36 


.76 


3.28 


.71 


.64 


Scientists should publish all findings 


2.75 


.93 


2.72 


.88 


.63 


Individual cannot change society 


2.20 


.94 


2,25 


.84 


.62 


Colleges have right to control behavior 
of students off campus 


1.22 


.59 


1.27 


.60 


.48 


Chief benefit of college is monetary 


2.17 


.96 


2.31 


.92 


,11 


Faculty promotions should be based on 
student evaluations 


2.87 


.86 


2.86 


.80 


.57 


My beliefs are similar to those of 
other students 


2.58 


.69 


2.60 


.68 


.66 


College officials should clear student 
publications 


1.93 


.90 


1.81 


.78 


.59 


Marijuana should be legalized 


2.76 


1.10 


2.75 1 


.08 


.88 


College has right to ban extremist 

speaker's 


1.65 


.87 


1.73 


.88 


.61 


Army should be voluntary 


2.92 


.98 


2.88 


.94 


.69 


Disadvantaged should be given pre- 
ferential treatment in admissions 


2.20 


.88 


2.25 


.90 


.74 


College officials too lax with student 
protests 


2.06 


.85 


2.12 


.86 


.66 


Alternative and si.or,’ng key: Agree strongly « 

somewhat « 2, disagree strongly * 1. 


4, agree 


somewhat 


* 3, 


disagree 
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Table 16 

Test-Retest Response Probabilities and Phi Coefficients 





for Checklist 


of High School 


Achievements 








High School Achievement 






p i 


P 2 


0 




Elected president of student organization (s) 




.26 


.25 


.90 




Received high rating in state/regional music 
contest 




.10 


.08 


.89 




Participated in state/regional speech/debate 
contest 




.07 


.07 


.92 




Had major part in play 






.21 


.20 


.96 




Won varsity letter (sports) 






.28 


.30 


.96 




Won award in art competition 






.07 


.06 


.88 




Edited school paper, yearbook, 
magazine 


literary 




.16 


.17 


.91 




Had original writing published 






.23 


.26 


.88 




Was member of scholastic honor 


society 




.25 


.25 


.96 




Received National Merit recognition 




.13 


.13 


1.00 






Table 17 












Stability of Reported Current Political 


Preference 






Current Political Preference 


1 2 


3 


4 


5 


Row 

Percentage 


1 


Left 


8.2 1.6 


0.5 


0.5 




10.9 


2 


Liberal 


2.2 45.7 


2.7 


1.1 




51.6 


3 


Middle of the road 


2.7 


17.9 


1.1 




21.7 


4 


Moderately conservative 




1.6 


10.9 


0.5 


13.0 


5 


Strongly conservative 






1.6 


1.1 


2.7 




Column Percentage 


10.3 50.0 


22.8 


15.2 


1.6 


100.0 






Table 18 












Stability of Expected Political Preference 


in Four 


Years 






Expected Political Preference 
in Four Years 


1 2 


3 


4 


5 


Row 

Percentage 


1 


Left 


9.2 




°.5 




9.8 


2 


Liberal 


1.1 45.7 


2.7 






49.5 


3 


Middle of the road 


2.7 


22.3 






25.0 


4 


Moderately conservative 




2.3 


12.0 




14.1 


5 


Strongly conservative 






0.5 


1.1 


1.6 




Column Percentage 


10.3 48.4 


27.2 


13.0 


1.1 


100.0 



ERiC 



50 



-46- 



Table 19 

Stability of Reported Participation in Protest Against 
Racial, Military, or Administrative Policy During Senior Year in High School 3 



Institution 


Protest Issue 




s - D -i 


*2 


S .D • 2 


x 


a Vi 


AS * D ♦ £ ^ 


Public university 
(N = 97) 




Race 


1.31 


.51 


1.35 


.58 


.69 


.04 


.07 




Military 


1.42 


.59 


1.42 


.59 


.76 


.00 


.00 




Admin is t r a t ion 


1.31 


.47 


1.38 


.57 


.36 


.07 


.10 


Private university 


(N = 62) 


Race 


1.61 


.64 


1.72 


.61 


.54 


.11 


-.03 




Military 


2.03 


.66 


1.93 


.66 


.79 


-.10 


.00 




Administration 


1.53 


.67 


1.47 


.62 


.59 


-.06 


-.05 


Community college 
6N « 43} 




Race 


1.63 


.43 


1.19 


.50 


.74 


-.44* 


.07 




Military 


1.63 


.43 


1.12 


.40 


.93 


-.51* 


-.03 




Adminis trat ion 


1.63 


.37 


1.09 


.29 


.29 


-.54* 


-.08 


Alternatives 


and scoring key: Frequently 


■3; occasionally 


= 2; 


not at 


all * 1. 



In this table and in Tables 20 and 21, a correlation of ,30 is necessary to be fairly 
sure (p. >.95) that the statistic is significant with degrees of freedom of at least 
40. 

* 

Difference significant at the .05 level. 

Table 20 

Stability of Freshmen Predicting Future Involvement 
in Protests about Racial, Military, and Administrative Policy 3 



Institution 


Protest Issue 


x i 


S.D. 


1 X 2 


S,I), 2 


£ 


AX 2-1 


AS • D ♦ ^ ^ 


Public university 


(N * 97) 


Race 


2.67 


1.04 


2.51 


1.00 


.73 


-.16 


-.04 




Military 


2.62 


1.08 


2.54 


1.00 


.85 


-.12 


-.08 




Administration 


2.67 


.93 


2.56 


.92 


.82 


-.11 


-.01 


Private university 
fN - 62) 




Race 


3.26 


.84 


3.18 


.84 


.81 


-.03 


.00 




Military 


3.35 


.87 


3.27 


.87 


.86 


-.08 


.00 




Administration 


3.11 


.81 


3.09 


.72 


.74 


-.02 


-.09 


Community college 

(N = 43) . 




Race 


2.07 


1.07 


2.04 


1.00 


.80 


-.03 


-.07 




Military 


1.95 


1.15 


1.91 


1.07 


.83 


-.04 


-.08 




Administration 


1.65 


.84 


1.72 


.73 


.73 


.07 


-.11 


Alternatives 
little chance = 2; 


and scoring key: Very 

no chance ■ 1. 


good 


chance * 


4 ; some 


chance * 3; 


very 
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Table 21 

Stability of Reported Attitudes on Items Pertaining 
to Student Freedom and Administrative Control 




Institution 


Item 


x i 


S.D . x 


X 2 


S *D • 2 


Jt 


iX 2-l 


AS.D. 2 ^ 1 


Public university 


(N = 97) 


Liberalism 


3.34 


.87 


3.43 


.86 


.93 


.09 


-.01 




Control acti- 
vists^ 5 


2.56 


1.12 


2.57 


1.07 


.57 


.01 


-.05 




Regulate off- 
campus be- 
havior 0 


1.25 


.69 


1.27 


.62 


.45 


.02 


-.24 




Regulate pub- 
lications 0 


1.96 


.95 


1.85 


.76 


.62 


-.09 


-.21 




Ban speakers 0 


1.66 


.89 


1.72 


.87 


.49 


.06 


-.01 




Administrative 

laxity 0 


1.99 


.77 


2.16 


.84 


.70 


.17 


-.07 


Private university 


(fi » 62) 


£ 

Liberalism 


3.92 


.67 ^ 


3.97 


.64 


.89 


.05 


-.03 




Control acti- 
vistsb 


2.15 


1.17 


2.13 


1.00 


.85 


-.02 


-.17 




Regulate off- 
campus be- 
havior 0 


1.13 


.42 


1.22 


.52 


.61 


.09 


.10 




Regulate pub- 
lications 0 


l.o2 


.75 


1.57 


.67 


.45 


-.05 


-.08 




c 

Ban speakers 


1.44 


.74 


1.44 


.72 


.77 


.00 


-.02 




Administrative 

laxity 0 


1.94 


.79 


1.89 


.79 


.60 


-.05 


.00 


Community college 


(N = 43) 


<1 

Liberalism 


3.19 


1.11 


3.15 


1.02 


.87 


-.04 


-.09 




Control acti- 
vists^ 5 


3.12 


1.26 


3.02 


1.19 


.62 


-.10 


-.07 




Regulate off- 
campus be- 
havior 0 


1.30 


.56 


1.35 


.65 


.49 


.05 


.09 




Regulate pub- 
lications 0 


2.2ft 


,83 


2.07 


.91 


.58 


-.21 


.08 




Ban speakers ’ 


1.93 


.91 


2.14 


.96 


.63 


.21 


.05 




Administrat ? ve 
laxity 0 


2.40 


.98 


2.37 


.95 


.63 


-.03 


-.03 


a Self-rating. 


Alternatives . 


and scoring key 


Highest 10 


percent = 5; 


above 



average = 4; average =* 3; below average * 2; lowest 10 percent * 1. 

Federal involvement. See Table 14, footnote a, for alternatives and scoring key. 

c Attitude item. Alternatives and scoring key: Agree strongly = 4; ageee some- 

what =3; disagree somewhat * 2; disagree strongly = 1. 
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Table 22 

Agreement Between Self-Reported and Recorded Freshman Grades 

(Proportions) 



Category 


l) 

Range 


Men 


(N - 2,090) 


Women (N = 2.325) 


Self- 

Reported 


Recorded 


Bias a 


Self- 

Reported 


Recorded 


Bias 3 


A/A+ 


3.67-4.00 


.02 


.03 


-.01 


.02 


.03 


-.01 


A- 


3.50-3.66 


.04 


.02 


+.02 


.05 


.04 


+.01 


B+ 


3.16-3.49 


.08 


.06 


+ .02 


.12 


.11 


+ .01 


B 


2.83-3.15 


.11 


.10 


+ .01 


.17 


.16 


+ .01 


B- 


2.50-2.82 


.16 


.19 


-.03 


.18 


.20 


-.02 


C+ 


2.16-2.49 


.23 


.20 


-.03 


.20 


.20 


.00 


C/C- 


1.50-2.15 


.29 


.31 


-.02 


.22 


.22 


.00 


D 


0-1.49 


.07 


.09 


-.02 


.03 


.04 


-.01 


GPA 


(0 - 4) 


1.78 


1.65 


+ .13 


1.96 


1.94 


+.02 



£ 

Bias refers to the difference between the self-reported and recorded values, 
and all nonzero differences are significant at the .005 level. 



This type of data should be replicated for other conversions between numerical 
and letter grades in common use. Different numerical ranges associated with each 
letter grade will probably change both self-reported and recorded grade proportions 
but have little effect on their differences or bias. 

Table 23 

Agreement Between Self-Reported and Recorded Freshman Grades of Black Students 



Category 


Range^ 


Men 


(N * 64) 




Women (N = 86) 




Self- 

Reported 


Recorded 


Bias 3 


Self- 

Reported 


Recorded 


Bias 3 


A/A+ 


3.67-4.00 


§ 

• 


.00 


.00 


.00 


.00 


.00 


A- 


3.50-3.66 


.02 


.02 


.00 


o 

o 

♦ 


.01 


-.01 


B+ 


3.16-3.49 


.03 


.02 


+ .01 


.03 


.01 


+.02 


B 


2.83-3.15 


.03 


.03 


.00 


.10 


.08 


+ .02 


B- 


2.50-2.82 


.22 


.22 


.00 


.14 


.13 


+.01 


C+ 


2.16-2,49 


.28 


.23 


+ .05 


.26 


• 28 


-.02 


c/c- 


1.50-2.15 


.38 


.42 


-.04 


.40 


.31 


+.09 


D 


0-1.49 


.05 


.06 


-.01 


.07 


.17 


-.10 



0 

Bias refers to the difference between the self-reported and recorded values, 
and all nonzero differences are significant at the .005 level. 



This type of data should be replicated for other conversions between numerical 
and letter grades in common use. Different numerical ranges associated with each 
letter grade will probably change both self-reported and recorded grade proportions 
but have little effect on their differences or bias. 
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Table 24 



0 and 0/0 

max 



for Self-Reported and Recorded Freshman Grades, 



by Sex and Race 



a 













Grade 








Group 


Coefficient 


A/ A-l- 


A- 


B+ 


B 


B- 


C+ 


C/C- 


D 


All men 


< * 


.69 


.49 


.56 


.42 


.39 


.40 


.59 


.60 






.70 


.59 


.65 


.44 


.42 


.43 


.62 


.71 


All women 


( * 


.56 


.41 


.52 


.43 


.38 


.37 


.62 


.46 




t/t 

max 


.78 


.43 


.56 


.44 


.41 


.38 


.63 


.53 




0 


.00 


1.00 


.70 


1.00 


.36 


.39 


.52 


.55 


Black men r 


(N-64) 


' 0/0 

max 


.00 


1.00 


1.00 


1.00 


.36 


.44 


.57 


.64 




0 


.00 


.00 


-.02 


.73 


.45 


.41 


.58 


.60 


Black women r 


(N*86) 


1 0/0 

max 


.00 


.00 


-.04 


.84 


.47 


.43 


.69 


1.00 



a In the case of dichotomous variables generated from the responses to a single 

category, the reliability as measured by the Phi coefficient is a function of the 

base rate, i.e., the frequency with which that category is checked. This, in turn, 

is not independent of the number of, and base rates for, the other categories. Hence, 

the Phi coefficients may be low even when there is a high concordance on retest. 

The Phi/Phi coefficients, which allow for variation in base rates, are much higher 
max 

and more consistent across categories, but have the disadvantage of representing an 
intrinsic relationship rather than one which is practical in correcting for attenu- 
ation in correlational analysis (Guilford, 1950). 

Table 25 

Self-Reported and Computed Proportions of Students in Age Categories 











Men (N » 


- 2,090) 




Women (N 


* 2,325) 












Self- 






Self- 








Category 






Reported Computed 


Bias 


Reported Computed 


Bias 


Age - 


22 






.02 


.02 


0 


.01 




.01 


0 


Age = 


21 






.01 


.01 


0 


.01 




.01 


0 


Age - 


20 






.01 


.01 


0 


.01 




.01 


0 


Age = 


19 






.11 


.10 


.01 


.08 




.07 


.01 


Age * 


18 






.80 


.80 


0 


.85 




.85 


0 


Age » 


17 






.06 


.06 


0 


.06 




.06 


0 


Age - 


16 






.00 


.00 


0 


.00 




.00 


0 










Table 


26 


















0 and 0/0 for Se '.f-Reported and Computed Age 

max 


















Age 


in Years 
















22 










16 




Group 




Coefficient 


or more 21 


20 


19 


18 


17 


or less 


All men 




{ 


0 


.88 .87 


.87 


.92 


.92 


.96 


— 










0/0 

max 


.89 .89 


.94 


.95 


.93 


.97 


— 




All women 


{ 


0 


.77 .71 


.83 


.93 


.90 


.92 


— 










0/0 Mav 

max 


.77 .98 


.93 


.96 


.91 


.93 







ERiC 
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Table 27 

Correlations Between Item Responses Processed by 
Optical Scanning and by Verified Keypunching 



Item Types 


Range of Correlations 


Median Correlations 


Demographic character- 
istics 


.97—1.00 


.99 


Financial Concern and 
Sources 


.95— .96 


.96 


Career Choice and Major 
Field 


.99 


.99 


Parents’ characteristics 


.88— .98 


.93 


High school accomplish- 
ments 


.98—1.00 


.99 


High school activities 


.91—1.00 


.95 


Goals 


.92— .98 


.95 


Attitudes 


.90— .98 


.93 


Expectancies 


.90— .98 


.95 



o 

ERLC 
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1969 STUDENT INFORMATION FORM 



YOUR NAME (please print) ■ ■ - — 

First Middle or Maiden Last 

HOME STREET ADDRESS 



City State Zip Code tif known) 



519294 



When were j } ~ p 

you born? I { I 

Month Day Year 
(01-12) (01-31) 





<§)<§><§><§><§> 


o 

cc 


(DOOCDO 


o 

LO 


©®<D©© 


X 

H 


(D<D<D<D<D 


XL 


0®®0® 




©®<D®® 


H 


©©©©© 


O 

Z 


®®®0® 


O 

O 


®®<§>©© 

®®®0® 



Dear Student: 

The information in this report is being collected as part of a continuing study 
of higher education by the American Council on Education. The Council, which is 
a non-governmental association of colleges and educational organizations, is 
soliciting your cooperation in this research in order to achieve a better uncles 
standing of how students are affected by their college experiences* identifying 
information has been requested in order to make subsequent mail follow-up studies 
possible. Your response will be held in the strictest professional confidence, and 
will be used onl y in group summaries for research purposes. 

Sincerely yours, 

uogan Wilson President 



® ® ® ® <S) (o) ® <§) ® 
©0000(1 >000 

(D 0 (D ® ® (D ® ® (D 
®®®® 0 ®®®® 
®®®®(D®®0® 
®<D<D®®(D©(g)<D 
®©©®0®®®0 
®®®®®®®®® 



DIRECTIONS: Your responses will be read by 
an optical mark reader. Your careh 1 obser- 
vance of these few simple rules wni be most 
appreciated. 

Use only black lead pencil (No 2*2 or softer). 
Make heavy black marks that fill the circle. 
Erase cleanly any answer you wish to change. 
Make no stray markings of any kind. 



Yes No 

EXAMPLE: Will marks made with ball pen or ® ^ 

fountain pen be properly read? 



1 . Your Sex: Male O • . 




2. How old will you be on 
year? { Mark one) 


December 31 of this 




16 or younger ..... .© 


20 


O 


17 O 


21 


O 


18 O 

19 O 


Older than 21 


O 


3. What was your average grade in secondary 
school? (Mark one) 




A or A*^ O 


8. O 




A- O 


c* O 




B+ O 


c O 




B O 


D O 





4. To how many colleges other than this one did you 
actually apply for admission? From how many did 
you receive acceptances? (Mark one in each column) 



No other ......... 


Applications 

o 


Acceptances 

O 


One 


o 


o 


Two 


o 


o 


Three 


o 


o 


Four . . . 


o 


o 


Five 


o 


o 


Six or more 


o 


o 



5. Mark one: 

This is the first time \ have enrolled in college as a freshman O 

I came to this college from $ j * college o 

I came to this college from a four-year college or university O 



6. The following questions deal with accomplishments that might possibly apply 
to your high school years. Do not be discouraged by this list; it covers many 
areas of interest and few students will be able to say "yes ” to many items. 
(Mark all that apply) 

Was elected president of one or more student organizations (recognized Yes 

by the school). * O 

Received a high rating (Good. Excellent) in a state or regional music contest . . . .O 

Participated in a state or reg ional speech or debate contest O 

Had a major part in a play o 

Won a varsity letter (sports) o 

Won a prize or award in an art competition O 

Edited the school paper, yearbook, or literary magazine O 

Had poems, stones, essays, or articles published O 

Pamcipated in a National Science Foundation summer program . . . o 

Placed (first, second, or third) in a state or reg ional science contest O 

Was a member of a scholastic honor society O 

Won a Certificate of Merit or Letter of Commendation in the National 
Merit Program * O 



7. What is the highest academic degree 
that y r intend to obtain? 

That your parents hope you will ob- 
tain? (Mark one in each column) 



None OO 

Associate (or equivalent) . . OO 

Bachelor’s degreerB.A.. B. S..etc. >00 
Master’s degree (M.A. . M.S.. etc.) . OO 

Ph.D or Ed.D OO 

M.D.. O.D.S, . o; D.V.M OO 

LL.B. or J.D OO 

B.D OO 

Other OO 



8. Do you have any concern about 
your ability to finance your col 
lege education? (Mark oner 

None (I am confident that I will 

have sufficient funds) O 

Some concern (but 1 will probably 

have enough funds) O 

Majoi concern (not sure 1 will be 
able to complete college). . .O 

9. Are you a U S. Cdizen? 



(Mark oner 

Yes. native born O 

Yes naturalized O 

No O 
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10. Through what source do you intend 
to finance the fi rst year of your 
undergraduate education? 

(Mark one in each row) 



lb Jb i, t) 
O O p 

$ £ £ 
c? «? 



$ # ^ 

# ^ ^ 

Persona; savings and or erv.loyment .OOO 

Parental o* other fann Iv aid . . OOO 

Repayable loan ooo 

Scholarship, grant, or other gift . ...OOO 

11. What is the highest level of formal education ob 
tained by your parents? (Mark one in each column) 





Father 


Mother 


Grammar school or kss.0 


o 


Some high school . . . . 


• O 


o 


High school graduate. 


o 


o 


Some college 


.©. 


o 


College degree 


. o 


o 


Postgraduate degree . 


o 


O 




12. What is your b est estimate of the total income 
last year of your parental family (not your own 
family if you are married)? Consider annual in- 
come from all sources before toves. (Mark one) 
Less than $4.000. . .O $15,000-519,999. O 

$4,000-$5,999 O 

$6,000*$7,999 O 

$8.000-$9,999 O 

$10. 000-514,999. . . •O 



$20,000-$24.999. o 
$25,000-$29.999. .0 
$30 000 or more . .0 



13. What is your racial background? (Mark one) 

White/Caucasian * O 

Black/Negro/Afro-Amencan o 

American Indian 0 

Oriental 0 

Other 0 



Religion in 
Which you 
Were Reared 



14. Mark one in 
each column: 

Baptist , , 

Congregational (United 

Chutcb of Chnst) O 

Episcopal O 

Jewish o 

Latter Day Saints (Mormon) O 

Lutheran o 

Methodist .... O 

Muslim . O 

Presbyterian 0 

Quaker (Society of Friends 1 ) 0 

Roman Catholic 0 

Seventh Day Adventist . . , . 0 
Umtanan-Umversaiist ....0 
Other Protestant . . , O 

Other Religions . . , O 

None 0 



Your Present 
Religious 
Preference 



O O 



..O 

..o 

• O 

..o 

• O 

..o 

• O 
.0 

• O 

..o 

..o 

• O 
0 

• o 

•O 



15. Where did you rank academically in your high 
school graduating c J a$s? iMark one) 
Topl%..,0 Top 10%.. O Top Quarter 0 
2nd QuarterO 3'd QuarterO 4th Quarter. O 



O 

ERIC 



16. During the next few years, to what extent do 
you think the Federal Government should be 
invoived in each of the following national 

issues? (Mark one in each row) 

1. Eliminate any existing pro- 
grams or remain uninvolved 

2. Decrease involvement from 
current levels 

3. Maintain current level of 
involvement 

4. Increase involvement from 
current level 

5. Initiate new crash program 
CD<3)d><3>CD Control of cigarette advertising 
00000 Elimination of violence from T.V. 

Control of environmental pollution 
©©©©© Use of tax incentives to control the 
birth rate 

©©©©© Protection of the consumer from 
faulty goods and services 
©©©©© Compensatory education for the 
disadvantaged 

©©©©© Special benefits for veterans 
©©©©© Control of firearms 
©<2><D©(D Elimination of poverty 
©©©©© Crime prevention 
00000 School desegregation 
©©©©© Compensatory financial aid for the 
disadvantaged 

©©©©© Control of student activists 

17. Where did you live for most of the time while 
you were growing up? 

On a farm ...... ...... ................ . 0 

In a small town. 0 

In a moderate size town or city . . . O 

In a suburb of a large city — o 

In a large city 0 



MAKE SURE YOU HAVE ANSWERED ITEMS 18-21 




18, Mark one in each row: 

1. Left 

2. Liberal 

3. Middle-of-the-road 

4. Moderately conservative 
■5. Strongly conservative 

O00Q0 How would you charac- 
terize yourself politi- 
cally at the present time 7 

©©©©© How do you think you will 
characterize yourself 
politically four years 
from now? 

19. How many miles is this college 
from your home? 



11-50. ...O 


50HOOO 


.0 


51*100. . . O 


More than 1000 


O 



20 from what kind of secondary school 
did yru graduate? (M?.rk j>ne) 

p uoiic 0 

Private (denominational) , , O 

Private fnon-denominational) . . . O 
Other 0 



21. How many brothers and sisters now 
living do you have? (Mark one in each 
row) 



j? 

- 






<v 

Number of older brothers. . oooo 
Number of older sisters , oooo 
Number of younger brothers0O00 
Number of younger sisters. OOOO 



Whot is your best guess as to the chances 


Very 

Good 


Some 


Very 

Little 


No 


that you will: (Mark one in each iow) 


Chance 


Chance 


Chance 


Chance 


Get married while in college? . . 


O... 


...O... 


...O... 


...o 


Get married within a year after college 7 


O... 


...O... 


...O... 


...o 


Obtain an A- or better over-all grade point average?. . 


o... 




...o... 


...o 


Change major field? 


o... 


..o... 


...o... 


...o 


Change career choice? 


o .... 


..o... 


...o... 


...o 


Fail one or more courses? 


o .... 


..o... 


...o... 


...o 


Graduate with honors? 


o .... 


.o... 


...o... 


...o 


Be elected to a student office? 


o... 


..o... 


..o... 


...o 


Join asocial fraternity, soronty, or club? 


o. ... 


..o... 


,o... 


...o 


Author or co-author a published article? . „ 


o .... 


o..., 


o... 


...o 


Be drafted while 1 am in college? 


O... 


..o... 


..o... 


...o 


Be elected to an academic honor society 7 


O .... 


..o .... 


..o... 


o 


Protest against U.S. military policy ? 


o... 




o... 


o 


Protest against administrative policy at this college? 


O .... 




..o... 


. o 


Protest against existing racial or ethnic policies? 


O .... 




o... 


.o 


Drop out of tins college temporarily (exclude transferring)?. .0 






...o 


Enlist in the Armed Services before graduating? 


o.... 


•O... 




...o 


Be more successful after graduation than most students 








attending this college 7 


o 


..o ... 


.©.... 


O 


Dtop out permanently (excTide transferring) 7 


o.... 


•O ... 


• O. ... 


..o 


Transfer to another college before graduating 7 


o.... 




o. ... 


• O 
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23. Mark one \n 



o 

S-> o-” 

At q S' 



i 



each column: 


j-, ^ 

£ & 


y ^ ^ 






O £ & 




$ £/ 
>?-<?/ 


J? , 


Alabama 


...o 


000 1 


Alaska 


..o 


000 1 


Arizona 


...o 


000 1 


Arkansas 


...o 


000 | 


California. 


...o 


0©0 fl i 


Colorado 


...o 


000 


Connecticut 


...o 


©00 


Delaware 


...o 


©00 


D.C 


...o 


©00 


Florida 


...o 


000 j 


Georgia. 


...o 


000 I 


Hawaii 


...o 


©00 


Idaho 


...o 


©00 


Illinois 


...o 


e©0 


Indiana 


...o 


©00 


lova 


...o 


000 


Kansas 




©0© 


Kentucky > , 


...o 


©00 


Louisiana 


...o 


©©0 


Maine 


...o 


0©0 


Maryland 


...o 


©©0 


Massachusetts. . . 


* s 

.. ^ 


©00 


Michigan 


• O 


0©0 


Minnesota * 


...o 


©00 | 


Mississippi 


■ O 


©00 j 


Missouri 


...o 


©00 1 


Montana . * 


...o 


©00 1 


Nebiaska 


...o 


000 1 


Nevada 


...0 


©00 1 


New Hampshire . . 


....o 


©00 1 


New Jersey 


...o 


000 1 


New Mexico 


...0 


00® 1 


New York 


...o 


000 | 


North Carolina. . . 


,...o 


©00 3 


North Dakota . . . . 


...o 


©00 1 


Ohio 


...o 


000 8 


Oklahoma ....... 


...o 


000 1 


Oregon 


...o 


©00 I 


Pennsylvania 


...o 


©0© 8 


Rhode Island 


...o 


000 I 


South Carohna. . . 


...o 


©0® 


South Dakota . , . . 


...o 


©©© 


Tennessee 


...o 


©0© 


Texas 


...o 


©0© 


Utah 


...o 


0©0 


Vermont 


...0 


©0® 


Virginia ........ 


• O 


©0® 


Washington 


• o 


©©© 


West Virginia — 


o 


0©0 


Wisconsin, ...... 


o 


©00 8 


Wyoming 


• O 


©00 8 


Canada 


...o 


©00 


Mexico 


...o 


©00 fl 


Puerto Rice. . . . 


....o 


©00 | 


Other Latin America. O 


0©0 1 


Europe 


...o 


000 1 


Asia 


...0 


©00 8 


Other 


...o 


0©0 H 



24, Mark o.r ly three responses, 
one in each column. 



ERIC 



Your probable career occupation. 
Your fathers occupation. 



r. 

/ / /-You. other' s occupation. 

©0© 



please indicate his (tier) last occupation. 



Accountant or actuary 

Actor or entertainer ......... 

Arcintect . , 

Artist 

Business (clerical) * 

Business executive 
(management, administrator). 
Business owner or proprietor . 
Business salesman or buyer.. 
Clergyman (minister, priest). . 

Clergy (other religious) 

Clinical psychologist 



,©©© 

.© 0 © 

.00© 

.000 

000 



000 

000 

000 

000 

000 

000 



College teacher 000 

Computer programmer ©00 

Conservationist or forester., , .000 

Dentist (including orthodontist) . . 000 
Dietitian or home economist. . . .....000 
Engineer ©00 

Fat met ot lanchet 000 

Foreign service worker 

(including diplomat) 000 

Housewife ©00 

Interior decorator 

(including designer) 000 

Interpreter (translator).. ... .000 
Lab technician or hygienist . . .....000 

Law enforcement officer ©00 

Lawyer \ attorney) 000 

Military service (career) . . 000 

Musician (performer, composer) . , , .00© 

Nurse ......... 000 

Optometrist 00© 

Pharmacist 

Physician 

School counselor 

School principal or superintendent 

Scientific researcher 

Social worker 

Statistician 

Tnerapist (physical, 

occupational, speech) 

Teacher (elementary). , , . 

Teacher (secondary) .... 

Veterinarian 

Write/ or j ournalist 

Skilled trades 

Other 

Undecided ............. 

Laborer (unskilled) 

Semiskilled worker .... 

Other occupation . 

Unemployed. . 



.000 

.000 

000 

000 

000 

.000 

©00 



. . .. 000 
.,..000 
. ... 000 

.....000 

00 © 

. .000 

0 

....J© 

.00 

.0© 

00 

© 



25. in general, my parents could be characterized as: 

(Mark one circle in each row) 



fr. 



1. Strongly pgree 

2. Agree 

3. Disagree 



0000 — 4. Strongly disagree 



Interested in intellectual pursuits 

Interested in cultural pursuits. 

Deeply religious 

Interested in politics 

Deeply concerned about t»eu children. 

Financially comfortable ♦ * . 

Having high aspirations for me 



.0000 

0000 

.0000 

.0000 

0000 

0000 

0000 



26. Below is a general list of things that students sometimes 
do. Indiccte which of these things you did during the past 
year in school. If you engaged in an activity 
frequently, mark “F”. If you engaged in an 
activLy one or more times, but not frequently, 
mark "0” (occasionally). Mack "N” (not at 
oil) if you have not performed the activity dur- 
ing the past year. <Matk one for each item) 



■$> ^ 

£ * 

4? 

Voted in a student ejection ©(g)© 

Came late to class * — ©©© 

Played a musical instrument. ® ® © 

Studied in the library..* ©©© 

Checked out a book or journal from the school library©®© 

Arranged a date for another student ©® © 

Overslept and missed a class or appointment ,©©© 

Typed a homework assignment * . * .©© © 

Discussed my future with my parents .©©© 

Fail ed to complete a homework assignment on time. .000 

Argued with a teacher in class 

Attended a religious service 

Demonstrated for a change in some racial or ethnic 

policy . 

Demonstrated for a change some military policy . 

Demonstrated for a change in some administrative 

policy of my high school. 

Did extra (unassigned) reading for a course 

Took sleeping pills * 

Tutored another student 

Played chess 

Read poetry not connected with a course 

Took a tranquilizing pill * 

Discussed religion - 

Took vitamins 

Visited an art gallery or museum 

Worked in a senool political campaign 

Workfd h a local, state, n national political 

0®0 
.000 
.©©0 
.00© 
.000 
.000 

Asked a teacher for advne after class ©00 

Htd vocational counseling ©00 

Stayed up all night ©00 



©0© 

©00 

©00 

©00 

.©00 

©00 

.©00 

.©00 

.©00 

.©00 

.©00 

©00 

©00 

.©00 

©00 



campaign 

Massed school because of illness , 

Smoked cigarettes 

Discussed politics 

Drank beer. 

Discussed sports 
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2L Below is a list of 66 different undergraduate major 
fields grouped into general categories. Matk onl y 
three of the 66 fields as follows: 

© choice {your probable major field of study). 
© Second choice. 

© The field of study which is least appealing to you. 
ARTS AND HUMANITIES PROFESSIONAL 



Architecture 


...©©© 


Health Technology 




English (literature) . 


. .00© 


tmedical. dental. 




Fine aits. 




laboratory) 


.00© 


History 




Nursing 


.00© 


Journalism {writing) 


00© 


Pharmacy ........ 




Language {modern) , 


. 00© 


Predentistry 


•00© 


Language (other) . . . 


00© 


Prelaw 


0©© 


Music 


• 00© 


Premedical 


.00© 


Philosophy 


00© 


Preveterinary 


.00© 


Speech and drama . , , 


.00© 


Therapy (occupat.. 




Theology, 


.00© 


physical, speech) 


.0©© 


Other 


.00© 


Other 


.00© 


BIOLOGICAL SCIENCE 


SOCIAL SCIENCE 




Biology jgeneial). . , . 


00© 


Anthropology 


.00© 


Biochemistry 


00© 


Economics 


00© 


Biophysics 


.00© 


Eduction ....... 


.00© 


Botany 


.00© 


History . . * ...... . 


.00© 


Zoology 




Political science 




Other 


00© 


(government, 
int. relations) . . . 


.0©© 


BUSINESS 




P$ycholog> 


00© 


Accounting 


.00© 


Social work 


Gd>© 


Business admin . . . . . 




Sociology 


00© 


Electronic dcta 




Other 


.00© 


processing 


.00© 




Secretarial studies . . 


00© 


OTHER FIELDS 




Other 


00© 


Agriculture 

Communications 


.00© 


ENGINEERING 




(radio. T.V., etc.). .0©© 


Aeronautical 


.00© 


Electronics 




Civil 




(technology). . . > . . 


.00© 


Chemical 


00© 


Forestry 


.00© 


Electrical ...... 


00© 


Home economics . . . 


.000 


Industrial 


• 00© 


Industrial arts 


00© 


Mechanical ......... 


00© 


Library science. . . . 


.00© 


Other 


00© 


Military science . , . 


.00© 






Physical education 


0©© 


PHYSICAL SCIENCE 




and recreation 


.0©© 


Chemistry 


00© 


Other {technical), , . 


0©© 


Earth science 


00© 


Other (nontechnical).©©© 


Mathematics 


00© 


Undecided 


.0©© 


Physics 


.0©© 




Statistics 


00© 






Other 


00© 







Please be suie that onl y three cycles have been marked in the 
above list. 
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28. Indicate the importance to you personally of 
each of t ! ,e following: (Mark one for each item) 



Becoming accomplished in one of the performing arts tact mg. 
dancing, etc.). 



£- O 
£ Q. ^ 

<3 s c 
o 

? f £ 

$ P I c 

^ O O 

^ <n ^ 

.©00® 



Becoming an authority on a special subject in my subject field .<§)©©© 



Obtaining lecognition from my colleagues for contubutions in my 

special field ®©0© 

Influencing the political stiuctuie .(f)©©© 

Influencing social values 0©0© 

Raising a family ®©0© 

Having an active social life ®©0© 

Having friends with different backgrounds and interests from 

min ° 000© 

Becoming an expert m finance and commerce 000© 

Having administrative responsibility for the work of others. . ...000© 

Being very well-off financially 00®© 

Helping others who are in difficulty ®00© 

Becoming a community leader * * . . . 000© 

Making a theoretical contribution to science 000© 

Writing original works (poems, novels, short stories, etc.) ©©00 

Never being obligated to people <D©00 

Creating artistic work (painting, sculpture, decorating, etc.). . .©©00 

Keeping up to date with political affairs, ©©00 

Being successful in a business of my own ©©00 

Developing a meaningful philosophy of life ©©00 



{ Agrae strongly ^ <? if I** 

29. Mark one in ) Agree somewhat ^ 

e«ch row: \ Disagree somewhat •§ ^ g g 

( Disagree strongly $ £ § 

Student should have a major role in specifying the T ▼ Q o 

college curriculum o o o o 

Scientists should publish their findings regardless of 

the possible consequences O O O O 

Realistically, an individual person can do little to 

bring about changes in our society . , . ...O O O o 

College officials have the right to regulate student 

behavior off campus o o © o 

The chief benefit of a college education is that it 

increases one's earning power o o o o 

Faculty promotions should be based in part on student 

evaluations O O O o 

My beliefs and attitudes ate similar to those of most 

other students © O O O 

Student publications should be cleared by college 

officials O O O O 

Marijuana should be legalized o o o o 

College officials have the right to ban persons with 

extreme views from speaking on campus. * . O O O o 

Only volunteers should serve in the armed forces. . * . o o o o 

Students from disadvantaged social backgrounds should 
be given preferential treatment in college admissions© O O O > 
Most college officials have been too lax in dealing 

with student piotests on campus o o O o 

Divorce laws should be liberalized* * . , . o o o o 

Under some conditions, abortions should be legalized o o o o 

There is too much concern in the courts for the rights 

of criminals o o o o 

Capital punishment (the death penalty) should be 
abolished O o O o 

N.W, Waihjngton, 0.C Pro<«t««d ty National Computtr System* 1013 South 6th Str**t Mp Is., Minn. 334U 
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SUPPLEMENTAL STUDENT INFORMATION FORM 

NAME COLLEGE 

TESTING # 

DIRECTIONS; This form is a continuation of the form you just completed. 

Please continue to indicate your answers by making heavy black marks 
that fill the circle. Continue to use only the black lead pencil. 

When you have completed both forms, make sure that your name and 
testing number is on both forms. Return the completed forms to the test 
administrator . 



1. How would you rate the academic standards of your high school? (Mark one) 



Very high 0 

Fairly high 0 

About average 0 

Probably below average 0 

Definitely below average 0 



2. To what extent do you think each of the following describes the 
psychological climate or atmosphere at this college? (Mark one 
answer for each item) 



Very 

Descriptive 



In Between 



Not at all 
Descriptive 



Intellectual 0 

Snobbish .......0 

Socia.- 0 

Victorian 0 

Practical-minded. 0 

Warm O 

Realistic 0 

Liberal 0 



O 

0 

O 

0 

0 

0 

0 

0 



O 

O 

O 

O 

O 

O 

O 

O 
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Answer each of the following as you think it applies to this college: 



Yes No 

The students are under a great deal of pressure to 

get high grades O 0 

The student body is apathetic and has little 

"school spirit" 0 O 

Most of the students are of a very high calibre 

academically * % O ...0 

There is a keen competition among most of the 

students for high grades . O. ...... .0 

Freshmen have to take orders from upperclassmen 

for a period of time . O ,0 

There isn't much to do except to go to class 

and study , o ...O 

I felt "lost" when I first came to the campus o O 

Being in this college builds poise and maturity 0 0 

Athletics are overemphasized 0. ...... .0 

The classes are usually run in a very informal 

manner O ........ O 

Most students are more like "numbers in a book" O O 

Indicate the importance to you personally of the following persons 
or events in your decision to enroll in this college. (Mark one 
for each item) 

Major Minor Not 

Influence Influence Relevant 

Parent or other relative 0 0 O 

High school teacher or counselor. 0 O t # o 

Friends attending this college 0. ...... .0 .0 

Graduate or other representative 

from this college.. O 0 O 

Professional counseling or college 

placement service O O 0 

Athletic program of the college 0 0 O 

Other extracurricular activities 0 O O 

Social life of the college .....0 0 O 

Opportunity to live away from 

home 0 0 .0 

Low cost 0 0 t .O 

Academic reputation of the college 0 O 0 

Most of the students are like me 0 0 0 

Religious affiliation O 0 O 
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5. Below is a general list of things that students sometime do. Indicate 
which of these things you did during your senior year in high school. 
(Mark one for each item) 



Frequently Occasionally Not at all 



Was a guest in a teacher's home 0. 

Rode on a motorcycle 0. 

Studied with other students O. 

Saw a foreign movie 0. 

Took a trip of more than 500 miles O. 

Got a traffic ticket O. 

Played tennis 0. 

Played bridge O. 

Gambled with cards or dice .0. 

Drove a car 0. 

Attended a ballet performance.., 0. 

Participated on the speech or 

debate team . 0. 

Acted in plays 0. 

Sang in a choir or glee club .0. 

Called a teacher by his or her 

first name 0. 

Wrote an article for the school 

paper or literary magazine O. 

Had a blind date 0. 

Wrote a short story or poem (not 

for a class) 0. 

Discussed how to make money with 

other students O. 

Attended a public recital or 

concert O. 

Went to an over-night or week-end 

party. O. 

Took weight- reducing or dietary 

formula O. 

Participated in an informal group 

sing O. 

Drank wine O. 

Cribbed on an examination O. 

Turned in a paper or theme late O. 

Asked questions in class O. 



.0 0 

.0 0 

.0 ,0 

. — ..«•««... .0 

.0 .0 

.0 o 

.0 o 

. 0 ...., o 

.0 0 

.0 0 

.0 o 

.O 0 

.0 o 

.0 0 

.0 o 

.0 o 

.0 0 

.0 0 

.0 o 

.0 o 

.o o 

.0 . .0 

.0 0 

.0 0 

.0 0 

.0 0 

.0 0 
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Agree strongly 
6. Mark one in Agree somewhat 

each row: Disagree somewhat 

Disagree strongly 

Current levels of air pollution in 
large cities justify the use of 
drastic measures to limit the use 
of motor vehicles . 

Urban problems cannot be solved with- 
out huge investments of Federal 



money O O 0 O 

Cigarette advertising should be outlawed 

on radio and T.V O O O 0 

College faculty are more competent than 

are students to specify the curriculum ....... O. .... 0 0 0 

The activities of married women are best 

confined to the home and family o O 0 O 

Parents should be discouraged from having 

large families .... O O O O 

Colleges would be improved if organized 

sports were de-emphasized O O 0 0 

Women should be subject to the draft 0 0.....0 0 

The voting age should be lowered to 18 0 0 0 0 




7. 



O 

ERIC 



Rate yourself on each of 


the 


following traits as you really think you 


are 


when compared with the average student of 


your owr 


age. We 


want the most 


accurate estimate of how 




see yourself 


. (Mark 


one for each item) 








Highest 10 


Above 




Below 


Low 


Trait 




Percent 


Average 


Average 


Average 


Pe 


Academic ability 




0 


, . . 0 . . . . 


. .0 


. 0 




Athletic ability ..... 




0 


, . . 0 . . . . 


. .0 






Artistic ability 




0 


, . . 0 . . . . 


. .0 






Cheerfulness 




0 










Defensiveness 








. . 0 


. 0 




Drive to achieve 




0 


. . 0 . . . . 


. .0 






Leadership ability . . . . 




0 










Mathematical ability . . . 




0 










Mechanical ability. . . . , 








. .0 


. .0 




Originality 








. . 0 . . . . . 


. . 0 ..... 


• • • 1 


Political conservatism 




0 


. . 0 . . . . 


. .0 


. .0 


4 


Political liberalism . . . 















10 



Popularity . O, 

Popularity with the opposite 



O, 



O, 



sex 

Public speaking ability 


. . 0 . . 


0 






Self-confidence (intellectual). 


. .0. . 


0 


.0. . . 




Self-confidence (social) 

Sensitivity to criticism 


. . 0 . . 

. .0. . 


• • . . . 0 ..... 
0 


.0. . . 

.0. . . 


.... 0 ........ 

. . . .0 


Stubbornness 


. . o. . 








Understanding of others 











Writing ability 0. . 



0, 



o 

0 

o 

0 

o 

0 

0 

o 
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